ED 106 508 



OOCOHEHT RESUHE 



CE 003 674 



AUTHOR 
TITLE 

IHSTITOTIOH 

POB DATE 
NOTE 

EDBS PRICE 
DESCRIPTORS 



IDENTIFIERS 



Altschuld, James H«; And Others 

Insurance: An Evaluation Report for the Occupational 
Exploration Program. 

Ohio State Oniv*, Columbus. Center for Vocational and 
Technical Education « 
Dec 74 

146p«; For related volumes see CE 003 668«*675 
HF-$0.76 HC-$6.97 PLDS POSTAGE 

Analysis of Variance; ^^career Education; Evaluation 
Criteria; Grade 8; Grade 9; Insurance Companies; 
^Insurance Occupations; * Junior High Schools; 
Occupational Choice; Occupational Information; Pilot 
Projects: deprogram Evaluation; Questionnaires; Role 
Playing; "^Simulation; Statistical Analysis; Student 
Reaction; Teaching Methods 

^^Career Exploration; Occupational Exploration 
Program; OEP 



ABSTRACT 

The evaluation report is one of seven produced for 
the Occupational Exploration Program (OEP) , a series of simulated 
occupational experiences designed for junior high school students. 
Describing the pilot testing of the simulation dealing with the 
insurance field, the report contains sections describing the 
simulation context, evaluation procedures, results, and a Reviser *s , 
Information Summary (RIS) • In the simulation, students operated an 
automobile insurance company, processing the claim resulting from a 
'^client's** automobile accident. Occupational roles included agent, 
client, reviever, inspector, underwriter, witness, rater, claims 
adjustor, claims examiner, and actuary. The experimental design 
involved two Colorado schools, with a total of four experimental and 
four control groups involving 79 eighth and ninth graders. 
Instrumentation included knowledge and affective testing, student and 
teacher questionnaires, and a panel review. Analysis of variance and 
other descriptive statistics were employed, and reliability estimates 
were calculated. Analysis of variance results revealed that the 
simulation had a positive impact on student occupational knowledge 
and preferences. The RIS records and extrapolates trends related to 
the strengths, weaknesses, and recommendations from all data sources. 
Appended materials include the evaluation instruments used and an 
observer form. (HH) 
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ABSTRACT " ' . 

INSUR/aiCE 

EVALUftTIOII BEPORT FOR THS OCCUPATIONAL EKPLORATIOH PROGRAM 
By: James W. Altschuld; Sandra Pritz; Janice Lave 



This report is one of seven evaluation reports produced for the Occupational 
Exploration Program. The Occupational Exploration Prograiii (O.E.P.) is 
funded by the National Institute of Education and is a Joint development 
effort of The Center for Vocational Education (The Ohio State University) 
and the Jefferson County, Colorado public schools. O.E.P. is a series of 
experiences designed to provide ounicr high school students with the oppor- 
tunity to explore occupations . One of the majo'z: vehicles for exploration is 
the simulation technique. In 'FY' 197^, 12 simulations vere developed and 
seven of those tvrelve vere pilot tested. This report describes the pilot 
testing of the simulation dealing yrith the Insurance field. The report 
contains sections describing simulation context, evaluation procedures, 
results and a Revisor's Information Summary (RIS). The RIS is useful for 
a variety of purposes and includes the strengths of the simulation as well 
as its weaknesses. Below is a synopsis of the specific content of the 
report. 

SB^^ION COICTEXS ; In this simulation, the students learn why insurance is 
necessary, how the industry developed, hovr insurance companies are organized, 
and the structure and types of occt5)ations in an automobile insurance company 
The students simulate the operation of an insurance conipany. One student 
role plays a client who purchases automobile insurance from one of the 
conqpany's agents. VJhen the client later has an automobile accident, the 
insiirance company has to process the claim. The occvcpational roles included 
in this simulation are agent, client, revie\^er, inspector, undenzriter,^ 
witness, rater, claims adjuster, claims examiner, and actoiary. EXPERPSSETAL 
DESIGN: For evaluating this simulation, k schools, two ftrom Jefferson 
County* Colorado and t^.^ i'rom Denver, Colorado vrere used, each school having 
one experimental and one control group. A teacher facilitated the implemen- 
tation of the simulation with each e>5)eri2aental group. The experimental 
and control groiips consisted of 8th and 9fch graders: 3^ students in the four 
experimental grouos and k3 students in the four control groiips. A modified 
laboratory or quasi-experimental setting \-;as utilized for product tryout. 
PISTRUIIFSn?ATION ; A 3^ items multiple choice imowledge test, "VJhat Do You 
Kno;/?", and a b item affective test, "What Do You Like?'', were administered 
as pre- and posttests measuring student loiowledge gain and attitudinal 
change. The student post-module questionnaire, "What Do You Think?", 
administered to the experimental group after completion of the sirmilation, 
measured studexit perceptions of the module. Two teacher questionnaires and 
two panel reviews (mid- and post) were designed to obtain teacher perceptions 
of the simulation. Observers were utilized to collect additional infor- 
mation about module implementation. AI-IALYSIS : The knovrledge test and 
affective test results were derived tiirough analyses of variance. Other 
descriptive statistics veve employed vrhere appropriate ( i.e., frequency, 
percent change). Reliability estimates were calculated to obtain the 



internal consistency estimates of the knovrledge test and to determine inter- " 
coder and intra-coder agreement for the attitude scale; RESULTS ; 
Results indicated that the simulation did produce statistically significant 
changes in student laiowledge in the insurance field (pCOOl) and near 
significant changes in student occupational preferences (p<.0^). Overall, 
the teachers and students vere positive in their reactions to the simulation. 
• RmSOR^S IIIFORMATION Slg'2-!ARY ; The RIS was designed -to noib only assist « 
revisers to assimHate information collected during the pilot-test, but also 
as a uniq\ie Mey of summarizing the data. The summaiy is a record of the 
strengths, veaknesses and recommendations for revisors from all data 
sources (i.e., student tests, student questionnaires, observer forms, and 
teacher questionnaires, etc.). Trends have been extrapolated vhich list the 
most apparent strengths and weakness of the simulation as well as recommen- 
dations to be considered in the revision of the simulation. 
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I. BRIEF DESCRIPTION OF THE MODULE 



The insurance module contains a preview^, a preparation section, 
seven maoor activities, and a summary. The first class session is^^sfent 
on the Preview, which consists of two parts, a slide tape presentation and 
a booklet. Both provide an overview of insurance including sections on:, 
why insurance is neccsseiry, how the industry developed, how insurance 
companies are organized, and specifically the structure and kinds of work 
done in an automobile insurance company. V/ith this overview as a basis, 
students are asked to decide if they would like to participate in the simu- 
lation. 

The Preparation section describes in booklet form the roles among which 
the students may choose. There are eight occupational roles: inspector, 
actuary, adjustor, examiner, policy rater, reviewer, underwriter, and two 
agents. The non-occupational role of the customer/insured must also be 
filled as woll as the short roles for a claimant and witness which, for 
convenience, are taken by the underwriter and the rater. Students are 
directed to decide on dob priorities and to list them on a Job Preference 
Form. 

A tree diagram based on role activities is available to aid those who 
have difficulty deciding on these priorities. The resource packet for this 
phase of the simulation also includes a Job Assignment Form and role-specific 
schedule cards to help students know how to progress through the module. 
The preparation phase lasts two days. 

For the beginning of the Part icipp^t ion Phase , students pursue activities 
according to their role. The agents and the customer (Ben Elliott) use 
the Task 1 Handbook, Sell- ^ng Automobile Insurance , to get basic information 

*Prior to the preview, the students have seen a slide/tape and/or a booklet 
on Introduction to Simulation . 
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about automobile insurance and the types of coverage available. The 
agents are directed to compete in trying to sell automobile insurance to 
Ben. The-^ent who is successful in doing so becomes the agent for the 



JWreck Less Insurance Company and proceeds to complete Ben's application. 
The other agent becomes the reviewer for Wreck Less. He joins the under- 
writer, rater, and inspector who are already practicing on Task 1* . Processing 
Applications . After having gained familarity with sample applications, the 
reviewer receives Ben's application and checks to see that it io complete. 
He passes it along to the inspector who investigates the credit standing 
of the applicant. Next the underwriter reviews the application to deter- 
mine the amount of risk involved, and the policy rater computes the 
insvirance premium. Task 2 is scheduled for two class periods. 

In the meantime, the claim adjustor, claim examiner, and actuary are 



spending the two periods working on Task A, Answering Inquiries » which all 
participants complete during the simulation, though at different times. A 
handbook provides information about insurance coverage which the students 
use to answer questions and develop solutions to case studies from the 
resource packet. 

When Ben Elliott's application has been processed, the customer becomes 
the insured and promptly has an automobile accident. The agent takes the 
report of the accident from the insured with the help of the Task 3 hand- 
book, Accident-First Report , and a talking page of instructions. Role- 
specific resource packets contain the necessary forms for the agent and 
the information needed to complete them for the insured. When the first 
report is complete, it is given to the claim adjustor, who has been studying 
the handbook for Task U, Invegtigation of Accidents . The claim odjustor 
directs the investigation and fills out the necessary reports after 
inspecting the vehicles, verifying the medical information, and talking 
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with the insured, the claimant, and the witness, (The latter two short 
Mon-occ\^ational roles are taken by the rater and the underwriter, respec- 
tively. ) 

•rhe completed reports are forwarded to the claim exeaniner who uses 
them in conjunction with the Task 5 handbook, Settling Claims , and bills 
from the resource packet for the insured fc.nd clajjnant. After determining 
the worth of the insurance claim, the claim examiner negotiates settlement 
with the insured and the claimant, both of vhom have had preparation from 
their role-specific version of the Task 5 handbook. Once the settlements 
have been agreed upon, the underwriter reviews Ben Elliott's insurance 
policy to decide if it should be cancelled as a res\xlt of the accident and 
consequent expense to the Wreck Iaiss Company. 

Throughout the accident investigation phase, the actuary works on the 
calculation of proposed insurance rates based on formulae and probability 
tables supplied in the handbook and resource packet for Task B, Calc\xlating 
Risk . 

At the beginning of the eighth class session, the groxip proceeds to 
the Summary and prepares presentations , either independently or in small 
groups, which will allow experiences and personal feelings about the acti- 
vities of the simulation to be shared. When the presentations are ready, 
a chairperson is chosen to formulate an agenda and to preside over the 
discussion. After all the participants have hitd a chance to give their 
presentations, they are given a Decision Point form, which encourages them 
to review and i5)date their individual occupational exploration plan on the 
basis of the additional input from the CQn5>letion of the insurance module. 

The following tale gives a breakdown of the simulation according to 
roles and class sessions. 
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II. DESCRIFTION OF EVALUATION PROCEDURES EMPLOYED 
Specific Saayle Used 

1. Schools - For this module two Jefferson County and two Denver 
schools were used. In each school there was one experiimntal 
and one control group. The schools and the teachers were selected 
via discussion with administrators ajid teachers in each of the 
districts. A brief description^^- of the schools follows. 
Alameda Jxmior High School (Grades ''^^S)^ Jefferson County 
Alaaeda Jtrnior High School is a small school with approxi-- 
mately 700 students in grades seven through nine. It seems to 
have a fairly stable school population in that school records 
indicate that over seventy percent {l^fo) of the ninth grade 
population have been in this particular school for three consecutive 
years. Additionally, very few of the ninth graders have attended 
more than two elementary schools. Lorge-Thorndike tests admini- 
stered at the school indicate a fairly nonnal distribution of 
student ability. The distribution of parental occupations shows 
that U8 percent of the mothers are working and that almost 5^ 
percent of the fathers are in managerial, professional, or skilled 
positions. The school population is primarily Caucasian (93 percent) 
with the remaining seven percent comir^ from other minority groins. 
Wheat Ridge J unior High School (Grades 7-9) » Jefferson County 
Wheat Rid/^e Junior High School is a small school with approxi- 
mately 725 students in grades 7-9* Twenty students are classified 
as mentally retardtjd. Generally, the school draws its student body 
from a middle clasij, blue collar area. About 30 students come 
from families receiving Aid to Dei>endent Children (ADC), and many 

•^^Descriptions were obtained by John Radloff of the Jefferson County 
project staff. 
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students are from divorced homes. The sxea, of Jefferson Coiinty 
served by this school has many older single family houses. There 
is a sizeable retired subgroup within the area pop\xlation. The 
students are primarily white (~93^) with the rest ('^T^) having 
Spanish surnames. The school reports that standardized test results 
indicate that school scores are improving and that it is either at 
or above district norms in most cases. 

Hamilton Junior High School (Grades 7-9) » Denver 
Hamilton Junior High School is a large school with approximately 
1,600 students enrolled in grades seven through nine. The area 
served by the school is quite large and over sixty percent of the 
students at Hamilton are bussed in each day. The students generally 
come from the middle income range but there are some students from 
upper income areas. Student achievement seems to be relatively high. 
(According to the assistant principal, over half of the seventh 
grade students maintain a B or higher .academic average.) The 
racial make-up of the school is estimated to be QO percent Caucasian 
and about 20 percent in minority groups. Further specification of 
the population was not available for this school. 
Lake Junior High School (Grades 7-9) > Denver 
Lake is a large Denver junior high school with well over a 
thousand students. Although demographic data was not available 
at ,the time of this writing, several factors about the school are 
known. First, it has a sizeable percentage of students with Spanish 
surnames. Secondly, Lake has a high rate of absenteeism. (As 
soon as additional data becomes available it will be appended to 
this report. ) 
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2. T eachers 

In each of the four schools, one teacher implemented the module with 
the experimental group of students. The following table contains a 
brief description of the experimental group teachers and the method by 
which they participated in the study. 



Table 2 - Description of Experimental Teachers 





Alameda 


Wheat Ridge 


Hamilton 


Lake 


Sex 


Female 


Female 


Male 


Female 


Subject 
Area 

Specialty 


Mathematics 


Foreign 
Language 


Social 
Studies 


Social 
Studies 


Had prior 
experience 
with sim- 
ulation 
techniques 


No 


No 


Data 
Not 

Available 


No 


Participa- 
tion 

selected/ 
or volun- 
teered 


Selected 


Volunteered 


II tt 


Volunteered 


Number of 
years 
teaching 
experience 


2 


13 


II M 


3 
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3» students 

In the following table the sajnple size, or number of students partici- 
pating in the experimental and control groirps by school and by sex, is 
given. The results indicate that while there was a similar proportion of 
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males and females in the experimental group, in the control group the 
proportion of males was somewhat greater. 

Table 3 - Frequency^ of Experimental and Control Peu-ticipants by School and Sex 



School 


Alameda 


\^meat 


Ridge 


Hamilton 


Lake 


Total 




Experi- 
mental 


Control 


Experi- 
mental 


Control 


Hlxperi- 
mental 


Control 


Experi- 
mental 


Control 


Experi- 
mental 


Control 


Males 


k 


h 


6 


6 


5 


12 


k 


6 


19 


28 


Females 


5 


, 9 


3 


5 


2 


1 


5 


2 


15 


17 


Total 


9 


13 


9 


11 




13 


9 


8 




h5 



^he firequency is based on participants with complete pre- posttest data sets. 



The experimental group participants were selected or volunteered 
from the following classes: Alameda - eighth grade students were 
selected from various classes; V/heat Ridge - eighth grade students 
volunteered from various classes; Hamilton - information not available; 
and Lake ninth grade students were selected fran a social studies 
class. 

At Alameda, the participating teacher described experimental students 
as being a very high ability group with no reading or comprehension 
problems. They were well disciplined throughout the simulation. At 
Wheat Ridge, the student growp included two low ability readers and one 
chronic absentee. The teacher felt the students with reading problems 
had difficulty in the pretests and posttests. Information concerning 
special student characteristics at Hamilton Junior High is not presently 
available. At Lake Junior High, the students were described as having 



9 

a "wide range of abilities." The pre- and posttests* level of diffi- 
culty \'ms felt to be dependent \ipon the ability of the individual 
student . 

The method by which the control groups were obtained is not totally 
clear.* In the testing of h modules in the Spring of 197^ it was not 
feasible for one individual to administer the tests. Therefore in each 
school either the experimental group teacher or another educator 
selected and administered the tests to a control group. It was suggested 
that testers try to select or sample students similar to those in the 
experimental group, i.e., if the experimental group was an English class 
then the tester was instructed to obtain a second English class for the 
control group. It is assumed that, to the extent possible, these 
directions were carried out. 

In e^ummary, the sampling was far from ideal. It was impossible to 
conduct more systematic sampling due to program and organizational 
constraints within buildings . It should be noted that experimental 
results are based only on students who completed both the pre- and post- 
test. There was sample loss in the testing of the module as described 
in the following table. 



"able h - Frequency and Percent of Sample Loss by Group 





Original Total 


Sample Loss 


Percent of Total 


Experimental 


36 


2 


Of, 


Control 


55 


10* 


1% 


Total 


91 


12 


13?& 



^ine of the ten subjects were from one junior high school. 



•^he time and monetary allocations for the pilot test precluded the use of 
extensive checks on the sampling procedures in the field. 
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Sample loss is always diffic\xlt to account for in an experimental 
situation. Some students may have been sick or otheivise out of the 
classroom during the pre- or posttesting time. Some students may 
simply have avoided taking the test. 

The sample loss in the experimental group is relatively small. 
However, the sample loss within the control group is considerably higher 
but not necessarily latrge. VJhen comparing the n*s of both groirps, the 
higher sample loss within the control group loses some significance 
since the number of subjects in the control group is greater than those 
in the experimental groiip (see Table k) . After considering all factors, 
it is suggested that the sample is not particularly great and will not 
affect the validity of the results. Therefore, efforts will not be 
made to study it in detail. 
B. Types of Classes or Groupings 

Knowledge of the type of class or group setting in which the 
module has been tried is important information in regard to interpreting 
the module results. For the k modules tested in the Spring of 197H, 
a mocified laboratory setting was utilized. Either a classroom or a 
space within a library was set aside for use by students participating 
in the module. When necessary, special equipment (e.g., video tape 
machines, sound on slide projectors, etc.) was provided and if possible, 
stored in the space designated for the project. It was felt that this 
specialized area would tend to: 

- reduce the number of competing or distracting factors for the 
simulating groi;^); 

- be representative of one way in which a school could iraplement the 
OEP program; 
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- reduce the necessity of moving equipment around from period to 
period; and 

- provide a place for students to store materials from one simulation 
day to the next. 

All experimental groups were conducted in this specialized or 
quasi experimental type of setting. Testing was also generally carried 
on within this setting. 

Experimental Design as Implemented 

There were two constraints on the implementation of the design 
as specified in the proposal for this module. Given the relatively 
small sample size, a decision was made not to include sex as a variable. 
■This eliminates the possibility of studying the test scores of males 
versus females, but inclusion of this variable would so reduce the cell 
size as to make meaningful interpretations difficult at best. The second 
constraint concerns the way in which the field test design was imple- 
mented. Four schools were tested, two classrooms or groups per school. 
Within each school one group was the experimental treatment and the 
other, the control treatment. It is apparent that no estimates of between 
class variability can be computed and that any unique classroom effects 
are confounded with treatment effects . However, the test of treatments 
* and associated interactions is assumed to be valid.* The design is depicted 
schematically in Figure 1 on the following page. 

The analysis will be the same as designated in the project proposal 
for the Occupational Exploration Program (FY *7^) with the exception that 
the sex variable has been deleted and two schools were added. Of key 

•^his statement is based on the presun5)tion that there were no unique 
classroom effects, one that is supported in earlier field trials. The 
reader should note that this design was implemented only after consider- 
ation was given to the practical aspects of implementing the design. It 
was the most feasible one given the field situation. 

18 



Figure 1 - Schematic of the Experimental 

Design for the Insurance Module 



Experimental 



Alameda 
(Jefferson 
County) 



Control 



Pretest 



Si 



Posttest 



Si 



Si 



Experimental 



Wheat 
Ridge 
(Jefferson 
County) 



Control 



Experimental 



Hamilton 
(Denver) 



Control 



Experimental 



Denver) 




^In order for a student's scores to be included in the analysis, he/she 
would have had to participate in both the pre and posttest. 
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interest will be the interaction between the experimental-control 
variable (B) and the pre- and posttest variable (c). If the module 
has had an impact upon students , a significant interaction would be 
expected with the source of the interaction being a sizeable experimental 
group gain on the posttest. Separate analyses will be run for the total 
cognitive test scores and for one dimension of the attitudinal scale. 
The analyses will be in accordance with the abbreviated summary table 
shown on page ih. 
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Table 3 - Partial Anova Siimmaiy Table 
for the Insurance Module 



lU 



Source 



Between Students 



Term No. 

1 

2 

3 
k 



A 

B 
AB 

d/ab 



Within Students 



5 
6 
7 
8 
9 



C 
AC 

BC 

ABC 
CD/AB 



df 



Potential F Test 



abn-1 



a-1 
b-1 

(a.l)(b-l) 
ab(n-l) 

abn(c-l) 



c-1 

(a-l)(c-l) 
(b-l)(c-l) 
(a-l)(b-l)(c-l) 
ab(c-l)(n-l) 



2/k 
3/h 



5/9 
6/9 
7/9 
8/9 



TOTAL 



abcn-1 



The independent variable for this modiae are described below: 



Variable 



6 



D 



Description 

Schools (Alameda, Wheat 
Ridge, Hamilton and Lake) 

Treatment (experimental _ 
vs. control) 

Testing (pre. vs. post) 
Students 



Fixed; between S's 
Fixed; between S's 



Fixed; within S's 
(repeated measure) 

Randcm; nested 
within AB combi- 
nations 
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Instrumentation - Instrument Specifics 

1) Knowledge Test - What Do You Know ? (The test is appended to this 

report. ) 

The knowledge test for the insurance module consisted of 3k multiple 
choice questions equally divided between items dealing with job res- 
ponsibilities and those dealing wr^,h processes in the field of adver- 
tising. In general, the questions were at a low comprehension level in 
relation to the Bloom Taxonomy. Below are examples of questions represent- 
ing the two basic areas emphasized in the test. An example of a 
responsibility question is: 

Test Question jfl 

1. Greta Gravely was in a bad accident. Her car was very badly 
wrecked and she spent two months in the hospital. To whom 
would she most likely tell the facts of the accident so she 
could settle the claim? 

*a. The claims ad^justor 

b. The actuary 

c. The underwriter 

d. The claims examiner 

♦Indicates correct response. 

Job responsibility questions generally deal with v7ho has the respon- 
sibility for getting a certain job done, or who has responsibility for 
making decisions at a certain point in time, etc. There were 17 respon- 
sibility questions on the test. The questions cut across all of the 
roles included in the simulation. 

The 17 process questions on the test deal with understanding the 
nature of steps involved in operating an insiirance company. The student 
must develop an understanding of activities such as insuring a client, 
investigating an accident; settling a claim, etc. An example of a process 
question is as follows: 
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Test Question //lO 

Before negotiating a claims settlement with a claimant, what 
should be considered in determining how much a claim is worth? 

a. Effect of injury on claimant's future employment 

b. Type of claimant's injury 

c. Amount of claimant's special damages 
*d. All of the above 

^Indicates correct response 

The following table shows the breakdown of the test items by test 
content and by the responsibility and process dimensions. The content has 
been divided into two axeas: general information and specific occupations. 
The test was designed to cover most of the major aspects of content 
presented in the module. 

Table 6 - Analysis of. Test Content 





Process 


Responsibility 


Total 


General Information 


k 


1 


5 


Special Occupations 








Inspector 


2^ 


2 




Actuary 


1 


1 


■ 2 


Adjustor 


1/2 


2^ 


3 


Examiner 




3 




Policy Rater 


1-^ 


1 


h 


Reviewer 




2 


2 


Underwriter 


2 


3i 


Agent 


5 






Client/claimant 


1 


1 


Total 


17 


17 


3h 



•*^Some items measured content related to two occupational areas, 
i.e., determining a common function or responsibility between two 
occupations. 
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2) Affective Test - Mhp,t Do You Like? (The test is appended to this 

report • ) 

The affective test was designed to raeasure student attitudinal 
change* The first six questions asked the student if he/she would like 
to try doing an activity. The student could respond in one of four ways 
to the item: 

(1) Yes, I would like to try this. 

(2) No, I would not like to try this* 

(3) I*m uncertain about trying this, 

(U) I don't have enough information to know if I would like 
to try this. 

The scale is scored so that the stronger the preference for trying 
to do an activity, the higher the score. Thus, yes and no responses 
receive the same scale value of 3> uncertain responses receive a 2, and 
not enough information types of responses receive a value of 1. These 
values are then summed and used in the analysis of variance described 
earlier. Summed scores can vetry from zero (no response whatsoever) to 
18. Note the scale is scored so that strength of preference, rather than 
direction of preference, is the important factor (i#e., yes and no 
responses, while being in opposite directions, represent the same strength 
of preference and therefore receive the same score). 

In addition to the scaled responses, students were encotaraged to 
state reasons for their preferences. These reasons were classified and, 
in conjunction with the scaled responses, were coded and transferred to 
machine scorable forms. Inter-rater and intra-rater agreement checks 
were made on the scoring process (See results section). The last question 
of the "What Do You Like?" test section asked the student to imagine 
himself /herself as a worker in the insurance field and to give advice 
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to another person by indicating what kind of experiences or activities 
might help him/her prepare for a job in insurance. (This question was 
used on a preliminary tri^a basis and the results are not included in 
this report.) * 

3) Student Post Module Questionnaire - i^at Do You Think? (The question- 
naire is appended to this report,) 

This questionnaire was administered to students in the experimental 
group after their coznpletion of the module and its posttest. The 
questionnaire was designed to measure student perceptions of the module. 

The first twenty questions on this questionnaire were forced choice 
in nature ~ the student could either agree or disagree with the state- 
ment posed in the stem. The twenty questions covered the following k 
areas : 

- perceptions of specific module parts (questions 1-7); 

- general understanding and ability to follow directions 
(questions 8-13); 

- implementation or pacing of the mod\ile (questions lU-l6); and 

- perceptions about learning (questions 17-20). 

Besides the first twenty questions there were twelve additional 
questions. Three of these were "check" questions designed to provide 
some probable indication of scale reliability. The rest of the questions 
were open-ended and asked the student to supply short answers or recommen- 
dations for improving the simulation. Examples of areas covered by these 
questions include: role(s) played; things liked most about the simulation; 
things liked least about the simulation; new interests discovered tlirough 
the simulation, etc. These questions will be summarized and included on 
the Reviser's Information Summary (RIS)* 
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U) Teacher Quest ionnedres (The (^uosticnnaires are appended to this report). 

Basically, two questionnaires were used for testing this module. 
The first, the Midway Quest ionnaircN - was completed by teachors approxi- 
mately half-way through the module. This questionnaire was filled out 
just prior to a mid -module panel review of the first half of the module. 
The questionnaire is designed to cover the initial elements of the simula- 
tion, i.e., the Introduction to Simulation materials, the Preview, the 
Preparation Phase, the first initial tasks, and the teacher^s overall 
perceptions up to the midway point. The questions dealt with concerns 
about technical quality, fit or integration with other sections of the 
module, appropriateness of recommended time allotments, problems encountered, 
recommendations for change* etc. The questions were primarily on a five 
point scale with space for open-ended comments frequently provided. 

At the end of the module and prior to the post modulti panel review^ 
teachers completed the General Module Evaluation . Thi.^ questionnaire 
was similar to the Midway Questionnaire, except that its content pertained 
to the Icist tasks and summary phase of the module and to the teacher's 
perceptions across tne entire module* It also contained questions dealing 
v;ith student and teacher back;u-ound. Generally, it was administered at the 
post module panel review session. The questionnaire would require about 
25-30 minutes co complete. 

In conjtinction with the two questionnaires just described, two optional 
forms were provided to teachers. These were the Media Checklist and the 
Daily Inventory of Perceptions (l)IP). The Checklist was simply a form that 
teachers could use if they so desired to record their feelings about media 
ut5ed in the simulation. The DIP was an open-ended diary form available 
for those teachers who were willing (or wanted) to keep daily notes about the 
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simulation. 

Data from the two questionnaires and the optional forms, if completed, 
will be suramaxized and reported in the Reviser's Information Summary* 

5) Teacher Module Panel Review 

As suggested above, teachers who pai*ticipated in the pilot test and 
taught the module were convened for a mid-module and post-module panel 
reyiev;. For each section of the module, the reviewers were asked to denote 
the strengths and weaknesses, the classroom solutions applied to overcome 
weaknesses, and recommendations for revision* The main reasons for the 
two panels were as follows: 

- the pai'iels v;ere a means of obtaining fresher or more recent 
teacher observations; 

- two shorter panels rather than a longer, more tedious panel would 
tend to reduce teacher fatigue; 

- the panels decreased trie need for longer questionnaires. 

As in the case of the first tnree modules tested in the Fall of 1973j 
panel reviews were conducted in accordance with the panel review guidelines 
generated for the nationwide CCEK pi*oject* A member of the panel kept 
detailed notes and after the panel prepared vTitton panel review reports* 
These are included in this document an^^. will be summarized on the RIS. 

6) Observer Forms (The form is appended to this report) 

For this pilot test, observers were utilized to collect additional 
information about module implementation* Observer data was collected for 
all schools with the exception of Lake Junior High School* The observers 
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were women and had or were in the process of receiving the bachelor's 
degree. The forms the observers used were a mixture of checklist and 
open-ended formats. Three basic areas were covered: media; general 
comments; and interaction and activities. The observations made were 
reviewed and collated and are summarized on the RIS. 
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III. RESULTS 



C. 7* Studant Questionnaire: Collated Open»£nded Responses to 

Questions trcm "What Do You Think?*' 



Question #25 

Maae sone of the things you liked most and liked least about the 
roles. 



Liked Most 

Filling out or checking fonts (8) 

Was interesting (2) 

Determining risk, premiums etc. (5) 

Being important (2) 

Selling (2) 

Working 9 talking vith and learning about 
others (7) 

Answering inquiries (3) 

Simulation • acting it out as it really 

happens (3) 

Inspecting vehicles (2) 
Single Responses: 

It vas explained well and was eaay 
to understand. 

I had enough time to do it in. 
Nothing 

Settling claims 

Intervieving 

I liked working 

Being witness 

Deciding things 

Using the calcxilator 

The cases 

Negotiating price 

Arguing who wae at fault 

Leam scnething about the Job 



Liked Least 

Reading so much, hard to 
understand (7) 

Filling out forms, reports (5) 
Too short (3) 

Sitting doing nothing, boring, 
waiting for others (7) 



Single Responses: 

Checking out applications 
The work 

Talking to people 

The applications were too 

ccntplicated 

All the formalities 

Some of the figures were different 

and wrong. 

Being the witness 

Need more customers 

Doing the math 

Don't have more premiums to check 
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C. 7. (Continued) 

(lucstion #28 * 

Najne sone of the mater icULs you liked nost and liked least. 
Liked Moat Liked Least 



PiljM, first fiOas (6) 
("I think in a film showing 
SGoething happening should 
have real people acting it 
out.') 

Booklets (9) 
Slides & Tapes (U) 

Single Responses: 

The calculator 
Nothing 

All the materials irere OK 

but could have done without them. 



Slides (6) 
Tapes (2) 
Talking pages (8) 
Films (2) 
Booklets (9) 
Packets {k) 

Resource materials (3) 
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C.7. (Continued) 

# 

Qaestlon #31 

Name flGne of the things you liked most and liked least about the 
sinulation. 



Liked Moat 

An individual role (9) 
Learning about insurance {k) 
Learning about different Jobs (2) 
Working irith others (U) 
Tasks (2) 
Sunnarj (2) 

Getting out of study (2) 



Liked Least 

Nothing to do at tiines (9) 
Preparation (2) 
Reading (5) 

It vaa a little confusing (2) 



Single Responses; 
Nothing 

There vas enou^ time to do 

everything in 

Forms 

Working 

This questionnaire 
Working vith only 9 people 
I liked it all 

It vas fun 8Lnd I experienced 
something more than the sane 
old school day. 



Single responses; 

Too long 
Too short 
The tests 

Digging for material 
Actuary, reviewer 
Too much acting 
Doing hard math 
Work sheets 
Doing the work 

There wasn^t enough time between 
the application and the wreck - 
not enough people. 
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c,7 (Continued) 



y/uestion #32 

Rec(xi»9DdatlonA to improve tbe slBAaatlon 

(The »08t freqaent responaes are listed In 8iiq;>llfied form.) 

More things to do (12) 
Less reading (3) 
Sijxqpler directions (2) 
Make it longer (2) 
Correct errors on forms (2) 
Make it more real (2) 
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III. RESUI/rS* 



S« 2. Teacher Mid-Module Bsuiel Review 



Title of Module: Insurance 

LEA : Jefferson County and Denver County^ Colorado 

Batnel Leader : John Radloff 

Panelists : Marilyn Bakanec, AlMscda Jr. 

Maxine ShpeuLl^ Lake Jr. 

Burt Fishy Hamilton Jr. 

Marge Bozarth^ Wheat Ridge Jr. 
Observer BBtrticipants : Del Barcus^ Coordinator of Career Education, D.P.S. 

Sandra Pritz, C.V.E. 
Date(s) Panel Met : April 22, 197U 
lluaber of Hours: Tiro 

^Interpretation has not been provided 
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III. RESUIfl?3^ 



E* 3. Teacher Post Mod\ae Panel Review 



Title of Module ; Inatarance 

LE A ; Jefferson C parity and Denver County, Colorado 

Panel Leader; John Radloff 

Panelists; Marilyn Bakanec, Alameda Jr* 

Buzi; Fish, Hamilton Jr* 
Maxlne Shpall, Lake Jr* 
Marge Bozarth, Wheat Ridge Jr. 

Observer Participants; None 

DateCsl Panel Met ; May 8, 1971* 

MuMiber of Hours ; 1 1/2 

^Interpretation has not been provided. 
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IV» Reviser's Information Summary (RIS) 
A> Description of the SiAmmary 

The Reviser's Information Summary vas developed for the purpose of 
assisting revisers to assimilate information collected during the pilot test 
of a xoodule. To accoii?)lish this, information from each source available 
was first reviewed and then only major thrusts or ideas from the source 
were summarized ♦ (Haese key thinasts or ideas were determined by the judgment 
of the authors of this evaluation report •) The summary was then transferred 
to the appropriate location on the large sheets which constitute the RIS. 
Lcustly, each column was studied and trends were drawn and so recorded at the 
bottom of the sheet. In ascertaining trends the authors used their familiarity 
with the module and data collected. 

In general there will be one Reviser's Information Summary sheet per 
part of the module and one-two sheets covering the overall nature of the module. 
On sheets which pertain to module parts, only some of the data sources provided 
information pertinent to that part. Hence, the sheets do have some blanks or 
missing data cells. The reviser should exercise extreme care in interpreting 
the information on the sheets and should always keep in mind that comments 
on the sheets represent only a summary of key xooints. In addition, it sometimes 
was most difficult to determine a trend in the iiiformation obtained. 

B. Use of t h e RIS 
( ne way the reviser might use the RIS is r-* jUows: 

1. Read the module - become thoroughly familiar with it; 

2. Read the first part of this report (Sections I and II) 
thoroughly. Skim the results compiled in tables 
(Section III, parts A, B, C, D and E.) Read sections 
E-2 and E-3, the teacher panel review reports, closely: 
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3* Read and study the Reviser's Information Siunraary* 
(CoMult original data sources, if necessary*); and 

k. Generate a set of revision specifications based upon 
knowledge of the module, the Reviser's Information 
Summary, project developmentail criteria and other 
information, if appropriate* 
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C. . REVISER'S INFORMATION 
SUMMARY 




DATA 
SOURCE 



STRENGTHS 



Insurance: Overall Co 
mKNESSBS 



TEACHER 
PANELS 



A majority of the teachers concurred that 
the module was very broadening to students 
who knew next to nothing about insurance. 
All felt that three weeks is a realistic 
time period for the unit. There was a 
difference of opinion about the degree of 
difficulty of the unit. Tvro of the 
classes found it hard overall, while the 
other two found it easy to manage. 



1. All of the teachers had proble 
occupied when tasks were finis 
instance, the adjustor tasks p 
student while others had nothi 
Task A are too short to balanc 
instructions to the teacher ab 
finish a task early should go 

2. Two teachers commented that t 
the heads of 8th-9th grade sti 

3. Three of the teachers had to 2 
throughout the simulation. Tt 
directions. 

U. There were several mechanical 
time looking for resource pack 
teacher did not always know tc 
passed, and all of the teacher 
out the materials when they gc 

5. Two teachers felt that the scl 
enough^ and all concurred the 
flow chart in the teacher's gi 
total picture of the simulatic 

6. The students in all grotqps wan 
one customer. 

7. The timing of one role switch 
8« In one group some of the stud 

use of the handbooks along wit 
9. The use of distractors in the 
the realm of the students' e:qi 
subpar readers. 



OBSERVER 
FORMS 



With teacher assistance^ the activities 
throughout the simulation generally 
progressed well. 
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There was some confusion with pac 
simulation. The teachers didn't 
was to be followed dcdly or if th 
spontaneously. Throughout the si 
when students had to wait for oth 
Students were confused by some te 
felt they didn't have as much inl 
the proper stage in their task, 
stated the material was corny an 
objected to so many written mater 
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REC0M4ENDATI0NS FOR REVISION 



CIS with keeping students 
hed at different times • ro>* 
Lied up and overwhelmed that 
ng to do* Also Task 2 and 

with Task 1« There are no 
out whether or not students who 
on« 

he entire simulation may be over 
dents • 

einforce the instructions 

students sometimes overlooked 

difficulties: pupils wasted 
ets when none existed, one 
whom the forms should be 
s had difficulty straightening 
t mixed up* 

edule card is not emphasized 
students could profit from the 
ide as they tend to miss the 
a* 

ted to service more than oust 
was unclear* 

ents were confused about the 
h resource materials* 
test items which are outside 
erience really penalize the 



ing of activities within the 
know whether the schedule 
activities could follow 
mulation, there was a inroblem 
trs to complete tasks* 
mnology* Several students 
'ormation as they should have at 
In one class, the students 

stupid. Some students 
ials* 



1* Provide additional and/or optional tasks to balance out 
task times* Also balance the tasks out among roles and 
provide directions for what students should do if they finish 
early* There should also be optional extra^ customers to 
service * 

2* Simplify the module or raise the grade placement* 

3* instructions at each step should stand out visually in all 
handbooks and instruction sheets* 

k. List on the schedule card all pieces which are to be used 
for each task, provide an inventory for teachers of all 
pieces in each envelope, and identify with a label each 
piece (and every page of each) with role names included* 

5* Provide a flow chart of the forms for the teacher's 
manual* 

6* Clarify the ambiguous role switch* 

7* Stress that the schedule card tells them what to do next. 
8* Cross reference the handbook and resource materials* 
9o Consider whether a homogeneous group might work best 
with this degree of interdependence* 
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DATA 
SOURCE 



STRENGTHS 



Insurance: Overall ( 



STUDENT 
TESTS 



Test data indicated that students possessed 
very little pretest knowledge of insurance • 
After completing the module, however, that 
knowledge increased by an average of 6.5 
points. In terms of cognitive awareness of 
the insurance field, the module had a sub- 
stantively and statistically significant im- 
pact on students. Generally the impact was 
found in test items dealing with occupational 
re spons ibility . 

With regard to attitude, students in the 
experimental group did envelop stronger pre- 
ferences although the pre t*^ posttest gain 
did not quite achieve statistical signifi- 
cance. 



One weakness or potential veaknes: 
test is that the experimental groi 
gain on the process items than it 
items. The module mav-place a he^ 
dimension and may neea some strenj 
process concerns in insurance. 



STUDENT 
QUESTION- 
MIRES 



The students indicated the following things 
they liked niost about the simulation: the 
individual rolesi learning about insurance, 
learning about different jobs, working with 
others, the tasks, the summary and being able 
to get out of study. 

The students stated they liked the following 
things about the roles: filling out or 
checking forms, determining risk, premiums, 
selling, being important, working, talking 
and learning about others, answering in- 
quiries and inspecting vehicles. The per- 
centage of students responding positively to 
various key statements is given below: 

Yes 

1% 
72% 
8k% 
8% 



The students indicated they liked 
about the simulation: having not: 
reading, the preparation section 
The students stated they liked tb 
their roles: having to read so m 
materials, filling out forms, doii 
for others to finish, and the lengi 
short) . 

The students responded in agreemei 

The role descriptions give me 
helpful in choosing a role. 

I had much or very much trouble 
next in the simulation. 



The preview and the other activities 
at the beginning helped to prepare me 
for the simulation. 

I selected a role by njyself . 

The simulation preview, activities 
and summary fit well together. 

I learned quite a bit about j'obs 
in this field of work. 

I enjoyed working with other 
students during the simulation 



TEACHER 
QUESTION- 
NAIRES 
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1. The teachers felt that overall it was a 
good simulation and that the students 
were receptive to simulation as a way of 
learning. Two of the three responding 
felt that the students had learned much 
(the third said an average amount) about 
the process of simulation. All felt that 
they would use the module again with 
modifications (2 said minor, 1 maj*or) and 
would recommend its use to others. 
(Continued on next page) 

7Z 



1. Three of the four teachers res 
experienced some problems witl 
fourth found no problems with 

2. All of the teachers experience 
students finished a task earlj 
This comment surfaces repeated 
weakness of the module. (The 
working ' individually is questi 
flow needs imiprovement with ev 

3» The sound pages were of poor q 



s identified by the knowledge 
up realised a somewhat snaller 
did on the responsibility 
avier stress on the latter 
gthening of its treatment of 



the following things least 
ling to do at times, the 
and confusing directions. 
5 following things least about 
ich, hard to understand 
ig nothing at times, v/aiting 
;h of the simulation (too 



it to the following statements: 

Yes 

Little information 
* knowing what to do 

50f, 



1. Need to develop more things for participants to do, 

2. Less reading. 

3. Simpler directions. 

Make the simulation longer. 

5. Correct errors in forms. 

6. riake it more realistic in terms of having police 
reports, etc. 



ponded that their students 
: the reading level. The 
this in her class, 
d difficulty when some 
' and had to wait for others, 
ly and appears to be the major 
entire concept of students 
oned by one teacher.) The 
ryone kept busy* 
uality. 




1. Improve the quality of the sound pages. 

2. Lower the reading level somewhat and make the directions 
more easily visible, i.e., use boxes or bold-face type. 

3. Provide more customers, more sample cases, and more 
activities to use as necessary to keep students busy 
and involved. 

k. Label all pages so that they will not get lost. 
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DATA 
M SOURCE 


STRENGTHS 


Insurance : Overall Con 
VEAKNESS 


_ TEACHER 
I QUESTIO^r. 
■ NAIRES 
(Cont'd) 


2. The students learned about the content 
of the module, much according to one 
teacher, an average amount according to 
two others. One teacher felt that the 
students were receptive to (interested 
in, excited by) the content, while two 
felt that there was average reception, 

3. Two teajchers responded that the materials 
stimulated student interest most of the 
time. Two others disagreed, responding 
"not much of the time." There was also 

a mixed reaction about any change in 
student interest as the module progressed 
with one teacher feeling that it depended 
on the particular job,' another that it 
lagged in the beginning but picked up 
later, and a third noting no change. 
Two of the teachers said that their 
students were able to understand the 
concepts presented most of the time, 
while one answered "some of the time" and 
another "not much of the time". (One 
teacher commented that there was some 
need for her to spend extra time on con- 
cepts for the actuary.) Two of three 
responding teachers felt that the main 
ideas and themes were presented with 
logical consistency, and the third felt 
that this was scxnewhat so. 

5. Two teachers felt that the directions 
were clear enough for students to under- 
stand what was expected of them, and the 
third felt they were average. 

6. Three of four teachers responding felt 
that the vocabulary was consistent with 
the maturational level of the students, 
and the fourth felt that was true of some 
of it. 

7. Transitions from phase to phase of the 
module worked average to well* 


• 


1 TRENDS 

Ierlc 


Both students and teachers were positive in 
their reactions to the module overall. Stu- 
dent test data indicated a substantial cogni- 
tive knowledge impact, and teachers felt that 
students had learned not only about insurance, 
but also about the process of simulation. 
Students gave many specific responses concern- 
ing what they liked about the simulation and 
about their roles (see student questionnaire 
box above) . All of the teachers said that 
they would use the module again (with modifi- 
cations) and would recommend its use to 
others. There were different opinions on the 
I>art of teachers with regard to ease of iniple- 
mentation, clarity of directions, understand- 
ing of content and vocabularjr, and student 
interest, in each case however, half to- three- 
fourths of the teachers responded positively. 


1. The major weakness of the mc 
and flow of the tasks. All 
students commented on having 
task before work could progi 
repeatedly observed in data 
There was a desire for addit 
roles except the adjuster, 1 
expanded . 

2. There was some feeling expre 
dents that the module could 
implement . 

3. The treatment of process con 
of responsibility aspects ac 

I 



iiderations (3) 
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RSCOMf^CNDATIOMS FOR REVISION 



iule appears to be the timing 
if the teachers concurred and 
to wait for others to finish a 
ss. (This type of comment is 
.ollected from the teachers.) 
onal customers as well; for all 
le activities needed to he 

sed 'by both teachers and stu- 
)e easier to understand and 

lerns was not as strong as that 
wording to student test data. 



The revisor should give careful attention to solving the 
balance problems with regard to timing and activities. 
Provision of additional and/or optional tasks should be 
considered. 

Some simplification appears to be called for, in reading 
level and concepts presented, as well as in the manage- 
ment of the materials and activities. 

More information may be needed at several specific points 

in the module. For example: 

-the role descriptions seemed to be inadequate; and 
-the details in. the accident reports may be too 
sketchy to permit clear resolution of the problem. 
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DAXA 

SOURCE 



STUDENT 

QUESTION- 

NAIRES 



TEACHER 

QUESTION* 

NAIBES 



STRENGTHS 



From an incremental test* done in the Fall 
of 1973 the following results were obtained: 
87^ (n = 15) or more of the students using 
the materials felt that they understood the 
materials and that the vocabulary was easy to 
understand* 



Insurance : Introducti- 

WEAKI^IESS 



When students were questioned wii 
enjoyment of the introduction, th 
etCo, the picture became somewhat 

- Only 5% of the students were 
enjoying the booklet or the 

- Only about l/3 of the student 
terms of liking the illustrat 



*Test data was collected from students in Upper Arlington, Ohio. 



Three of the four teachers rated the booklet 
good, and the fourth rated it average. The 
slides were rated good by two teachers and 
average by one. 



Two teachers commented that the 
that there was too much time wit 
teacher noted that her students 
the drawings in the slide/tape j 



TEACHER 
PANELS 



Teachers commented that the reading level of 
the booklet was about right. The concept 
of the importance of the individual's 
feeling of responsibility to the group was 
regarded as good. 



The teachers felt that the studex 
was but that the booklet should 
giving a better idea of the irapl: 
emphasis on the need for coopera 
the pupils were not impressed wi- 



OBSERVER 
FORMS 



Information collected from both Upper 
Arlington and Colorado tended to basically 
TRENDS I be corroborative in nature. Specifically, 
students seemed to understand the material, 
and the vocabulary and reading levels were 
approximately suitable for the age group, 
addition the teachers generally saw the 
quality of the booklet and slides as being 
good. 



lo As noted elsewhere the mater i 
enjoyable for students. 

2. The students were not particu 
illustrations o 

3. The teachers in Colorado, in 
In) booklet should give expanded 

student cooperation in the si 
was some teacher ^oncerji reg? 
material and the 'fact that s1 
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RECOMMEITOATIONS FOR REVISION 



h regard to their overall 
quality of the materials, 

more mixed in nature. 

firm in their statement of 
lides . 

s were strongly positive in 
ions • 



Slightlj' over one-half of the students recommended that the 
slides and booklet be used together, with the slides coming 
first. 



materials were too short and 

nothing to do. A third 
^ere not too excited about 
ogram. 



All of the teachers recommend using both the slides and 
booklet . 



ts already knew what simulation 
ave been extended to allow for 
cations of simulating with more 
ion* Two teachers noted that 
h the drawings. 



1. Expand the sections on responsibility and dependency on 
others . 

2. Use photographs • 



als were not especially 
Larly impressed with the 

:his instance, felt that the 
overage of the need for 

nulation. Additionally, there 
ding the brevity of the 

adents did not have much to do. 



1. 
2. 

-3^ 



Expand sections on responsibility and cooperation. 
Use photographs rather than drawings. 
Both students in Arlington and teachers in Colorado 
agreed that both the slides and booklets should be used. 
^. See RIS sheets in the reports for other modules with 
regard to the Introduction. 
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atmcR 




Insurance : Pr 


STRENGTHS 


WEAiaiESSE 


mm 1 


- 




I RAIRBS 




- 


TEACHER 
QUESTION- 
1 KAIBES 


Three of the four teachers gave a high 
rating to the technical quality for media 
and illustrations. 


The teachers had mixed opinions a 
information was provided to help 
participation (rather pertinent-1 
pertinent-l) and the ability of t 
to participate (high-1, medium-2, 
that the preview was too short, t 
quickly, and not enough informati 
idea of the module. 


1 TEACHER 
■ PAHEIS 


• 


1. Three teachers concurred that 
and lacking in content. The 
need to be stronger to motiva 

2. All of the teachers agreed th 
on vocabulao./ and the job des 

3. All felt that the math slide 
actuarial candidates. 


■ OBSERVER 
1 FORMS 


The observers noted that work progressed 
well in the preview and there was some 
general discussion. 


In two classes, the students comj 
the end of period and then there 


TREHSS 


1. Students were quite positive with regard 
to the initial activities being a good 
preparation for the rest of the module. 

2. Teewhers rated the technical quality of 
the media and illustrations as being high. 


According to teachers there were 
the preview. While the revisor a 
listed above, special attention i 
the motivational aspects of this 
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RECOMMENDATIONS FOR REVISIOfT 



)out how much pertinent 
students decide about module 

average-2, not very 
le preview to motivate students 
low~l) V/eaknesses noted were 
le slide information moved too 
)n was given to get a good 



One teacher would like to see something done to *'Jazz up" 
the preview. 



the preview wa^ too short 
feeling was that it would 
e the students to opt in. 

it not enough time was spent 
riptions. 

ras frightening for the 



1. Stress interdependence. 

2. Expand and detail slide /tape presentation. 

3. Eliminate math slide. 



.eted the activity before 
/as nothing for them to do. 



several major weaknesses in 
lould consider all of those 
irhaps should be given to 
section. 



1. It may be necessary to include more information in the 
preview, especially with regard to Job descriptions 
and content of the module • However, at the sanie time, 
care should be taken to make the preview motivational. 

2o See above column for other recommendations. 
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1 SOURCE 


STRENGTHS 


Insurance : rrep 
WEAWIESSJ 


1 STUDBNI 
■ QUESTION- 

wnas 


• 








1 TEACHER 

QUESTIOM- 
« IIAIBE3 


All four teachers agreed that the initial 
role descriptions provided students vith 
adequate (very-2, rather-2) information for 
selecting roles. Students understood for 
the most part how to use the schedule cards, 
and they selected roles independently in one 
group and independently but with some diffi- 
culty in two other groups. Resolution of 
duplicate choices seemed to go easily with 
some teacher assistancs* The tree diagram 
and schedule cards were mentioned by one 
teacher and another commented that the pre- 
paration moved smoothly. 


Some roles were attractive to the 
agent) while others were not (i.e 
some teacher assistance was neces 
roles. (Svaluator^s note: This t 
did not use the schedule cards at 
that understanding of vocabulary 
for her students. 


_ TEACHER 
■ FAREIS 


All of the teachers felt that the want ad 
booklet wai very good and that the decision 
tree was a good technique. Three teachers 
noted that job conflicts were solved happily 
be a flip of a coin. 


1. There was no schedule card fo 

2. Three teachers commented that 
allotted, and one got more in 
as "fill". 

3. Two teachers felt that confua 
adjuster and examiner, and un 


OBSERVER 
• FORMS 


Students participated well in selection and 
discussion of various jobs involved in unit. 


Some students in one class were r 
all the material. After students 
end of period, there was no moven 


■ TRERDS 


All sources of data concur in a positive 
assessment of the role selection process. 
This included the want ad booklet, the 
schedule card, and the decision tree. All 
conflicts with regard to selecting roles were 
easily resolved. 


1. Role descriptions are in need 
expansion. 

2. Most of the other weaknesses 
(see above) . 
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ration | 

1 


DO 

RECOMMENDATIONS FOR REVISION 


1 — L 




Junior high students (i.e., 
, actuary). In one group 
ary to get the students into 
acher was the only one who 
this time.) One teacher noted 
nd what people did was hard 




Ben EUiott. 

the task took less time than 
brmation on insurance to use 

on existed between claim 
erwriter and actuary. 


1. Provide a schedule card for Ben Elliott. 

! 2. Reduce the time allotted to the preparation to one day. 

3 Make clearer job descriptions and consider using the 
schedule cards to give students an idea of what they 
would do in each role. 


)t interested in reading 
completed activity before 
mt to the next task. 




)f improvement and probably 
sited are minor in nature 


Again the recommendations are quite minor and the rsviser 
is simply referred to the above column. 

j 



r 



DAIA 



STREitGTHS 



Insurance : 1 

WRAKNESSE 



STUDBNT 

qUBSTION- 

RAIRES 



TEACHER 
NAIBES 



If there was difficulty finishing 
Elliott, it slowed everyone dowi. 
talking page not working properly 



mCHER 
PANELS 



1. All of the teachers agreed thi 
felt let down and that the rei 
unrelated to the preferences 
to be an agent in the flrt pli 

2. All fi^ur teachers noted that 
page of job application instn 

3. One teacher felt that it was 
customer idle while the agent) 
talks. 



OBSERVER 
FCStMS 



TRERDS 




After materials were organized, the activity 
went well and students appeared to be 
interested. 



At the beginning of Task 1, it ^ 
to help the students organize ma' 
occurred simultaneously. In one 
interaction between the agent (s) 
Students had to wait until Ben c 



No particular strengths were noted by the 
teachers for this task. 



1* The one agent who loses out i 
the reviewer role. These two 
terms of interests or activit 

2. If the agent is slow in compl 
keeps others waiting idly. 

3. The quality of the sound page! 



Jask 1 
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the agent's work with Ben 
There was difficulty with the 



at the unsuccessful agent 
viewer role given to him was 
he had which led him to want 
ace* 

the sound page. for the first 
actions was of poor quality* 
a problem to have the 
s vere preparing their sales 



1. 



2. 



The job for the unsuccessful agent needs to be more 
related to sales than the re^riewer job is; or it should 
be considered whether the sales competition is that 
necessary* 

In5>rove the quality of the sound page. 
Amplify the customers' information. 



^as necessary for the teacher 
terials for the tasks which 
class, there wasn't much 
and Ben (the elastomer), 
hose his agent. 



,n the competition moves into 

roles are not similar in 
;ies» 

eting the policy forms, it 
\ is poor. 



The materials might be grouped for ease of delivery to 
students (e.g.. Task 1 schedule and handbook together) . 



1. Relate the unsuccessful agent's second role more to his 
interests. 

2. Improve the quality of the talking page. 

3. Add more background information for the customer to 
use in his communication with the agent. 



DASA 
■ SOURCE 


STRENGTHS 


Insurance : 

WEAKNESS! 


■ QUESTION- 

■ HAIRES 






^ TEACHER 

■ QUESTION- 

■ \ NAIRES 

\ 




One teacher commented that the ch 
reviewer to complete the applicat: 
developed. One teacher felt that 
set of materials as the worst of ' 


■ JBACHBR 
EAHBLS 




Two teachers felt that the t^le 
about letter and nuiober symbols. 


1 OBSERVER 
FORMS 

I 


Work progressed well on jobs assigned • 


Underwriter was confused by tern 


■ TRENDS 
I 

r ^ 

ERLC 


No apparent strengths were noted • 

■ - 84 


# 

The charts used by the rater and 
seen as inadequate. It seems thj 



ask 2 

J 
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irts used by the rater and 
on i-iere not adequately 
she would rate the inspector's 
he module. 



The role of reviewer should be beefed up so the "losing 
agent" doesn't feel like he lost. 



i vrere not explicit enough 



Inclogy on forms. 



the revievrer were generally 
it more detail is needed. 



ERLC 



Make the tables more explicit. 



1. Provide more details in the charts. 

2. Make the reviewer's role something more than an 
"etcpty role" for the "losing agent." 



85 



SASA 1 
1 SOURCE 1 


STRENGTHS 


Insurance: Tfi 

WEAKNESSE 


m STUDENT | 
I QUESTION* 1 
RAIRES 1 






^ TEACHER 

■ QUESTION- 

■ HAIRES 




The agent tended to hold up othei 
the accident report* 


TEACHER 
PiWBIS 




The teachers agreed that the agei 
quickly or the whole process bogi 
that little use was made of the i 


1 OBSERVER 
FORMS 


Work progressed T'ell getting started 
in their various Jobs^ 


1 Students were confused with some 
liability limits) ♦ 

1 ^ 


■ TRENDS 


1 No strengths were commented upon* 


j Teachers felt that the agent's i 
given the fact that others were 
j order to proceed. The sound pa^ 
j according to the teachers* 
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\ 

1 » 

1 V 

1 ' . 


1 
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RECOMMEi«)ATIOHS FOR REVISION 








• 


rs, taking time to fill out 






it must perform his tasks 
5 down* They also noted 
sound page. 


\. Provide another accident case so the agent does not 
intentionally prolong work or report in order to have 
something to do. Also build in some lead time for the 
agent • 

Ic?^rove the technical quality of the sound page or 
consider eliminating it. 




terminology and concepts (i.e.. 








The teachers suggested building in some lead time for the 
agent to complete the accident report and then giving him 
additional cases to work on. They would also like the 
sound page improved or eliminated. 




work was too time-consuming 
waiting for his report in 
ge was technically inadeq^^ate 


' S 




\ 




ERIC 


57 


, 



DMA 

SOURCE 



STRENGTHS 



Insurance : 
WEAKMESSE 



QUESTION- 
KAIRES 



TEACHER 
QUESTION- 
NAIRES 



All three teachers responding felt that 
the claims adjustor's set of materials were 
the best of the module, although one felt 
that it also seemed the most difficult • 



The teachers commented that the 
deal to do in two periods and it 
that they needed more time alloti 
split into two Jobs. 



TEACHER 
PAHEIS 



All teachers agreed that the Carbon Copy 
concept pleased students. Three teachers 
connented that the students involved in this 
task enjoyed it most of all. 



The teachers noted that the adjus 
was not in his materials (hospita 
etc.) and that there was no alert 
the agent, examiner, etc. Three 
not enough information was given 
accident (i*e., the status of the 
reach a clear resolution. 



OBSERVER 
FORMS 



Work progressed well on filling out 
accident forms after Ben Elliott *s 
accident . 



Some who were waiting for accide 
much time on their hands. While 
are either questionning what to 
unrelated to simulation. 



TRENDS 




Teafihers* coiments about this task were 
generally positive. They felt that the 
students en;Joyed this task particularly 
and that the claims adjuster's materials 
were good. 



1. The teachers agreed that the 
t^do relative to the time a! 
work was held up. 

2. There was no indication that 
needed information from othei 

3. Insufficient information was 
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claims adjuster had a great 
held up others • They felt 
;ed or possibly could be 



tor needed information that 
1 records, mediCcil report, 
to seek information from 
of the teachers felt that 
about the true facts of the 
stop light) for pupils to 



it form to reach them had too 
students are waiting, they 
io next or doing something 



claims adjustor had too much 
lotted, and therefore others' 



the adjustor should seek 
s« 

given about the accident • 




1. Add all necessary information or advise students as 
to where it may be obtained. 

2. Consider adding a police report. 



Suggestions from teachers included: 

l) advising the student playing the adjustor to seek missing 
information (or providing it with materials) and 2) either 
allowing the adjustor more time or splitting his job up. 



SB 
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— 




BASA 
1 SOURCE 


STRENGTHS 


Insurance • 

WEAKNESS! 


M STUDBMT 
I QUESTION- 






■ RAIRBS 


■ 




^ TEACHER 
1 QUESTION- 
■ MAIBES 




One teacher felt that there was i 
allowed* 


TEACHER 


One teacher felt that this was the most 
enjoyable task for her g>^oup« 


1* Three of the teachers noted tl 
to the task were missing (see 


PAHEIS 


• 


2. All four teachers agreed that 
due to waiting for the adjustc 

3* Three teachers felt that the a 
that they could ask for cc»apeD 
(The pain, and suffering concej 
they did not understand how to 
There wets no provision for wha 
not "be reached* 


1 OBSERVER 
FORMS 




Students had to wait un^il the c] 
work before proceeding to the sumn 
ff4?t not enough information was g 


■ TRENDS 


One teacher commented that this was the 
roost enjoyable task for her class « 


The major weakness according to i 
had nothing to do while waiting i 
his work* Some other difficultie 
enumerated above* 
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REC0t4MEI©ATI0NS FOR REVISION 



oo much to do for t>e time 



at many small facts necessary 
page 1 of handbook) . 

the students became very bored 
to complete his work. 

;udents did not understand 
nation beyond actual expenses. 

was missed.) Similarly, 
bargain for settlement, 
to do if a compromise could 



Expand explanations to cover more possibilities, 



N 



Edm adjuster completed his 
aiy activity. One observer 
ven about V^e accident. 



iachers was that the students 
>r the adjuster to complete 
were encountered and are 



Attention should be given to the problem of pacing one role 
versus the others. Teachers also felt that the coverage 
of the negotiation of a settlement should be expanded. 



ERIC 



91 



I — ] 






1 

SAXA 


STRENGTHS 


Insurance: 1 

WEAKNESSI 


1 — ^ 

STUDENT 

■ QUESTION- 

■ RAIRES 






TEiU^HER 

■ QUESTION- 

■ NAIRES 




There were not enough cases, not 


■ TBACHEIt 
PAKEIS 


The teachers felt that the level of humor 
was good and that the students were well 
motivated. 


The teachers all felt that there 
students finished the task at vai 
also noted that the situations w< 
meaningful to kids, i.e., wife s\ 
whole range of special questions, 
sufficient materials for each sti 


I OBSERVER 
POBMS 

/ 


0 


In one class, students felt theri 
materials . 


m TKBRDS 


Teachers noted that the level of humor 
(in the cases used for the task) was good 
and that the students were well motivated. 

✓ 

* 


Again, the problem of students' y 
of speed surfaced. Some teacheri 
have been provided. Teachers all 
situations were confusing and no^ 
students. There were insufficiei 
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isk A 



RECOMMENDATIONS FOR REVISION 



inough to do« 



ras difficulty in that the 
rly- different rates. They 

confusing and not 
Ing husband opens up a 
None of the teachers had 
ent. 



1. Provide additional tasks above minimal level for faster 
students • 

2. Use less confusing situations or add some more normal 
situations. 

3. Provide a Task A packet for each pupil in the simulation • 



weren't enough Task A 



)rking at different rates 
felt that more cases should 
I felt that the case 
suitably relevant for 
; materials to go around. > 



The teachers suggested improving the case situations and 
adding more, as well as providing additional packets so 
each student would have one. 
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DASA 

SOURCE 


STRENGTHS 


Insurance: 

WEAiaiESSE 


SIUDBNI 
QUESTION- 
NAIRES 






TEACHER 
QUESTION- 
NAIRES 




One teacher noted that she had to 
the actuary. She felt the materifi 


TEACHER 
FAHELS 




The teachers agreed that some of 
inaccurate. Three teachers comme 
more instructions about establish 
interpretation. 


OBSERVER 
FORMS 







TRENDS 


No strengths were commented upon. 


There were some difficulties note 
to progress through the activity- 
some of the entries on the tables 



I 
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Task B 
ES 


RECOHMEmTIONS FOR REVISION 






) spend much extra time helping 
.als were good but difficult. . 




' the table entries might be 
ented that the actuary needs 
hing premiums and chart 


1. Correct any math errors. 

2. Explain reasons for the formulas the actuary uses. 




. 


Bd in the actuary being able 
unaided. Teachers felt that 
5 were possibly in error. 

ER?C 


Teachers suggested correcting any math errors ^nd providing 
expanded explanation for the actuary. 

/ 
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OAXA 
g SOURCE 


STRENGTHS 


Ir.surance : Sun 
WEAKNSSSE 








I QIJESTION- 

n NAIRES 






TEACHER 
■ QUESTION- 
1 NAIRES 


The summary was rated by the three teachers 
responding as of medium effectiveness in 
providing a culmination for the module. The 
integration with the preceding tasks was 
average. Two teachers felt that it was some- 
what effective in helping students learn 
about occupational roles performed by others 
ia the simulation, and the third felt that 
it was very effective depending on the skill 
of the moderator, the willingness of the 
individual to shcre, and the ability of 
others to ask questions to assure complete 
reports. One teexsher noted that students 
became aware of all of the many details that 
go into insuring a car. The summary was 
ratfed by two of the three teachers as some- 
what useful in helping to make decisions 
about participation in other occupational 
exploration activities. 


The summary does not give enough 
set up their presentations accorc 


TEACHER 
■ PANELS 


All teachers agreed that the summary has 
great potential and that the sharing during 
the suinary 'is the only way tne students 
know what others did. 


The teachers concurred in all of 

1. The pupils were not well prei 
a lag in interest. 

2. More instructions more explic 
outside the body of the susm 
tions are needed for the chaJ 
structure . 

3. If the summaary did not go we] 
any student growth in areas 1 


OBSERVER 
m FORMS 


They didn't want a job in the ir •ranee 
field. 




TRENDS 


A majority oi* the students felt that the 
summary helped to pull things together* 
Teachers noted that the students had the 
opportunity only here to find out what the 
others did and that there was great 
potential as a result. More specific 
strengths are noted in the teacher question- 
naire summary above. 


There was a^eement among the tet 
for the stunniary to go well, or si 
others* roles. 

Additionally, students needed raoi 
guidelines as well as a rechargir 
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guidelines for students to 
ing to one teacher • 



the following remarks: 
)ared for the summary due to 

;it3y stated are needed 

iry. Especially, more instruc- 

xperson to provide more 

a, the posttest will not show 
;hey did not experience. 



One teacher suggests that since the summary is crucial 
to students • understanding of others' Jobs, the teacher 
may have to help the moderator. A list of questions 
could be prepared to assist the moderator in getting 
information from other participants. 



lo Provide a worksheet for the summary (did you work with 

people, data, things, indoors, outdoors, etc.). 
2. Make the summary a really solid e^qperience. 



One observer felt the last 2 pages of the summary handbook 
were confusing and unnecessary. 



achers that it was important 
indents would not know about 

re explicit instructions and 
ag of their interest level. 



One teacher's suggestion was to provide role worksheets 
for the summary and/or question lists for the moderator. 
The summary should be regarded as an important experience, 
perhaps requiring teacher aid. 
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Knowledge Test - "What Do You Know?" 
and 

Attitude Scale - "Wh.at Do You Like?" 
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The project presented/reported herein was performed purst^ant to 
a £crant fi-om the ^Jational Inctitute of Kducation, Oepartmont of 
Health, Education, and Welfare. However, the opinions expressed 
herein do not necessarily reflect the position or policy of the 
National Institute of Education, and no official endorsement by 
the National Institute of Kducation should b3 inferred. 

Copyright I97h by th-^ Ohio State University, The Center for. 
Vocational and Technical Education. 

Copyright for these materials is claimed only durin:^ the period 
of development, test, and evaluation, unless authorization is 
granted by the National Institutf^ of Kducation to claim copyright 
also on the final materials* For information on the status of" 
the copyright claim, contact either the copyri^^ht proprietor or 
the National Institute of Kducation. 
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INSURANCE 



WHAT DO YOU KNOW? and WHAT DO YOU LIKE? 



This booklet contains two short tests. The purposes of the tests 
are to find out what you know about work in the insurance field 
and what kinds of activities you might enjoy doing in insurance. 
These tests will not in any way affect your grade. 

Directions: To complete the first test use the answer sheet and 
pencil that have been provided. In one corner look for the blanks 
marked "Course/* "Instructor," etc. Then indicate the class you 
are in, in the space marked "Course/* write in your teacher |3 
("Instructor") name, your name, and your school ("Campus") in the 
spaces provided. Then right above where you've been writing, dark- 
en the spaces which indicate your sex and today's date- 

For eVch question on this test there are several short phrases or 
statem^^ts listed. Pick the one that best describes your answer 
and then darken the appropriate space opposite the item number on 
the answer \sheet. Note: on the answer sheet the item numbers go 
across the page instead of up and down. 

If you don't know the answer to a question, GUESS . 

Thanks for your help. 




You may turn the page and start as soon as you have completed 
reading the above paragraphs. 



3ir 



101 



INSURANCE 



"WHAT DO YOU KNOW?" 



FILL IN THE FOLLOWING INFORMATION 



Name Age Grade 



START THE TEST 

1. Greta Gravely was in a bad accident. Her car was very badly 
wrecked and she spent two months in the hospital. To whom 
would she most likely tell the facts of the accident so she 
could settle the claim? 

a. The claims adjuster 

b. The actuary 

c. The underwriter 

d. The claims examiner 

2. Who must check the work of the insurance agent? 

a. The rater 

b. The information clerk 

c. The inspector 

d!. All of the above 

e. Only a and c 

3. What is the main difference between the responsibilities of 
a claims adjuster and those of a claims examiner? 

a. Only the examiner negotiates claim settlements 

b. Only the examiner interviews people 

c. Only the adjuster investigates the accidents 

d. Both a and b 

e. Both a and c 

4. Joe Dotes has caused an automobile accident during the pro- 
bationary period of his insurance policy. Who decides if 
his policy should be dropped or kep 

a. The policy reviewer 

b. The underwriter 

c. The actuary 

d. The policy rater 



O 
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5. The underwriter would most likely be involved in which of the 
following activities? 

a. Investigating an accident 

b. Writing up an insurance application of a customer 

c. Determining the risk involved in insuring a customer 

d. Preparing accident reports 

6. What does a ^policy reviewer do in an insurance company? 

a. Figures out charges for insurance policies 

b. Checks insurance applications for errors 

c. Contacts employers to check information on the application 
d- Prepares tables of data 

7 . Which worker in the insurance industry would tend to do a lot of 
night or weekend work? 

a. The claims adjustor 

b. The inspector 

c. The agent 

d. The claims examiner 

8. What is the responsibility of an inspector for an insurance 
company? 

a. Interviewing witnesses to an accident 

b. Checking applications for errors 

c. Inspecting vehicle damage in an accident 

d. Checking credit information on an application 

9. In case of accident, whom should you notify in your insurance 
company? 

a. The adjustor 

b. The inspector 

c. The claims examiner 

d. The agent 

10* Before negotiating a claims settlement with a claimant, what 

should be considered in determining how much a claim is worth? 

a. Effect of injury on claimant's future employment 

b. Type of claimant's injury 

c. Amount of claimant's special damages 

d. All of the above 

11. Based on the profits and losses of an insurance company over a 
period of time, who adjusts the rates charged by the company 
for policies? 

a. The underwriter 

b. The claims adjustor 

c. The actuary 

d. The agent 
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12. 



Who has the responsibility for contacting personal references, 
employers and credit bureaus to check information on an insur- 
ance application? 



a. The underwriter 

b. The actuary 

c. The reviewer 

d. The inspector 

13. As an automobile insurance agent working in a small town you 
might be called upon to do which of the following tasks? 

a. Take first reports of an accident 

b. Determine the rates that the person to be insured must pay 

c. Make a judgment as to who is at fault in an accident 

d. Estimate the costs of repairing damaged autos 

14. What does an insurance agent need in order to do his/her job? 



a. Application forms 

b. Accident report forms 

c. Tables of data 

d. All of the above 

e. Only a and b 

15. Which of the following people work with insurance applications? 

a . The actuary 

b. The accountant 

c. The inspector 

d. The information clerk 

16. What is a major duty of a claims examiner in an automobile 
insurance company? 

a. To check insurance applications for completeness 

b. To interview accident victims 

c. To settle damages made against the company as a result of 
an accident 

d. Only b and c 

17. What is the first step taken by an insurance company in investi- 
gating an automobile accident? 



a. Investigation of the insured 

b. Investigation of the claimant 

c. Inspection of vehicles 

d. Investigation of the witness 

18. Who in the insurance company might be referred to as a detective?" 



a. The policy rater 

b. The agent 

c. The claims adjuster 

d. The underwriter 
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19. 



What step comes first in processing an insurance application? 



a. Figuring out the price for the policy 

b. Reviewing the application for errors aud omissions 

c. Investigating the credit standing of an applicant 

d. Determining the risk involved in insuring an applicant 

20. Mary Jones has failed to fill in all the information that has 
been requested on an insurance application form. Who, in the 
insurance company, has the responsibility for discovering what 
information has been left off the form? 



a. The inspector 

b. The reviewer 

c . The examiner 

d. The information clerk 



21. If you were calling an insurance company to get information 

on types of coverages, who could probably answer your questions 
most accurately? 

a. The rater 

b. The claims adjuster 

c . The reviewer 

d. The agent 

22. Which of the following sets of facts does an agent need to 
know in order to sell insurance? 
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a. Formulas for computing amount of risk 

b. Basic types of coverage 

c. Customer credit ratings 

d. Commission rates 

23. Which position in an insurance company is similar to the 
position of (some) one who helps to settle labor disputes? 

a. The claims examiner 

b. The policy reviewer 

c. The underwriter / 

d. The insurance agent 

24. l^hich one of the following people is most likely to use the work 
of the inspector? 

a. The underwriter 

b. The actuary 

c . The agent 

d. The claims adjuster 

25. Who is responsible for proces55ing applications in an insurance 
company? 

a. The underwriter 

b. The policy rater 

c. The reviewer 

d. All of the above 
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If the underwriter does not do his job carefully, what effect 
will it have on the insurance company? 

a. Good customers may be turned down 

b. High risk customers may be accepted 

c. The company may lose money 

d. All of the above 

Who would be most likely to use tables based on facts collected 
from many automobile accidents? 

a. The actuary 

b. The inspector 

c . The accountant 

d. The reviewer 

What do the numbers 36/24/36 stand for as used in the insurance 
industry? 

a* They refer to the length of time that different parts of an 
insurance policy are good for, in months 

b. They refer to the limits of liability (responsibility) of 
the insurance 

c. They refer to costs for different parts of an insurance 
policy 

d. They are the dimensions of a pretty young girl who was 
injured in an accident 

What task is the responsibility of the insurance agent? 

a. Completing bank drafts for injury and damages 

b. Inspecting wrecked cars 

c. Interviewing witnesses 

d. Preparing first accident reports 

What is the responsibility of the policy rater in an insurance 
company? 

a. Figuring the risk involved in insuring someone 

b. Checking the rates the agent quoted 

c. Figuring new rates /or the territory 

d. Approving applications 

In which of the following jobs would you be most likely to work 
in an office with regular hours? 

a. The inspector 

b. The agent 

c. The claims adjuster 

d. The rater 
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32. An individual has applied for insurance with A-OK (but) B-Sur 
liisurance Co., but his application was turned down. Who prob- 
ably made the final decision to reject the application? 

a. The reviewer 

b. The underwriter 

c. The claims adjuster 

d. The policy rater 

33. Karen has been badly hurt in an accident and she is negotiating 
with a claims examiner. They cannot reach a settlemexit. What 
will most likely happen neKt? 

a. She will drop her claim 

b* She will bring a suit against the insurance company (in cpurt) 

c. She will negotiate with another claims examiner 

d. She will settle the claim directly with the insured 

34. The adjustor and the inspector have which of the following 
activities in common? 

a. They prepare tables of data 

b* They collect facts 

c. They help to determine rates 

d. They determine risk factors 
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INSURANCE 



••WHAT DO YOU LIKE?** 



This is the second set of questions for you to answer. The 
purpose of these questions is to find out what types of activ* 
ities you might enjoy doing in the . insurance field. We would 
also like to know what reasons you have for liking these activ- 
ities. 

There are only seven (7) questions to answer. Directions for 
answering are found on each page. Write your answers directly 
on the page. 

After you have completed the questions r please return this book- 
let and your answer sheet from the first test to your teacher. 
Thanks for your help. 



Please turn the page and begin the questions as soon as you have 
finished reading the above paragraphs. 
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?• Below is a conversation between two people. Person 2 is 

looking for a job and is considering the insurance business. 
Person 2, an employee in an insurance company, is thinking 
about giving person 1 some advice. Pretend that you are 
Person 2, giving advice. Simply complete person two's 
advice at the end of the conversation. 



Person 1: 
Person 2: 



Person 1: 

Person 2: 
Person 1 : 

Person 2: 



Hi pal, how's it going? 

Well, aside from having my car stall in the 
morning rush hour, every things pretty good. 
How's it with you? 

Fine, but I've been thinking about going into 
a different line of work. Insurance looks 
interesting. Don't you work for an insurance 
company? 

Yes, I've been w\th Acme Insurance Company 
for the last two years. 

Listen, would you help me out? Would you tell 
me what kind of experiences or activities might 
help me to prepare for a job in the insurance 
field? 

Sure, here's what I would do if I were you. 



ERIC 



110 



Stunont Questionnaire 



- "What Tjo You Think 
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"WHAT DO YOU THINK?" 



NOW that 7ou^ have completed this simulation, the people who developed 
it would like to find out what you think about your experience. Your 
ideas will help to make the simulation better. Remember, THIS IS not 
A TEST and your answers will not be graded. So feel free to check 
and to say what you think about this simulation. 

TO complete the questionnaire first fill in the information requested 
below. 

FILL IN THE FOLLOWING INFORMATION 



l^ame 



Date 



School ^_City. 



Age 

Grade (circle one) 8th 9th Other (please specify). 
Sex (circle one) Male Female 

Subject taught in this class 

Teacher's name . 



START THE QUESTIONS 

This is a list of statements which describe ideas about the simulation 
module you have just completed. Answer each statement by checking the 
category which comes closest to what you think: 

Check " AGREE " if you think the statement is true for you. 

Check "DI SAGREE " if you think the statement is NOT true 
for you7~ 



AGREE DISAGREE 



1. The preview and the other activities at the 
beginning helped to prepare me for the 
simulation. 

2. The role descriptions gave me little 
information helpful in choosing a role. 
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3. I selected a role by myself* 

4. The teacher helped the class to 

select roles. 

5. Some of the tasks were too complicated 
or too hard for me to do. 

6. The summary helped me to "pull things 
together. " 

7. The simulation preview, activities and 
summary fit well together. 

8. There were too many forms to fill out with 
this simulation. 

9. The directions in the materials were clear 
to me. 

10. The teacher explained a lot of words. 

11. The pretest and posttest were difficult for 
me. 

12. The booklets and resource materials were 
easy to read. 

13. The teacher explained a lot of ideas. 

14. The simulation was too short. 

15. Sometimes I had nothing to do. 

16. Sometimes I had too many things to do in 
this role. 

17. I learned quite a bit about jobs in this 
field of work. 

18. I learned very little about how to work 
with other people. 

19. The simulation did not help to answer 
some of the questions I have about jobs. 

20. I enjoyed working with other students 
during the simulation* 
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Answer these questions by circling the letter in front of the phrase 
that best describes your answer* 



21* How much do you feel you learned about jobs in this field of work 
from the simulation? 

a. Very b. Much c. An average d. Little e. Very 
much amount Little 

22. How much trouble do you feel you had knowing what to do next in 
the simulation? 

a. Very b. Much c. An average d. Little e. Very 
much amount little- 

23* How would you judge the length of time you spent participating 
in this simulation module? 

a. Too b. Long c. Just d. Short e. Too 
long right short 



For the next questions # write in your answers. Space has also been 
provided for you to write in any comments/suggestions you might have. 
You are encouraged to do so. 



24. What role (or roles) did you play in this simulation? 



25. Name some of the things you liked most about the role(s) and som<? 
of the things you liked least about the role(s) . 

Liked Most Liked Least 



26. What other roles in the simulation did you find interesting? 



27. Why did you find this role (or roles) interesting? If you did 
not find any other roles interesting, can you say why? 



28. Name some of the materials (Examples: slides, tapes, films, 
resource materials, booklets, etc) you liked most and some 
of the materials you liked least s If you did not use any 
materials y check this space. 

Liked Most Liked Least 



29. Compared to your former feelings, how do you now feel about 
jobs in this area of work? 

WHY? 

I am more interested now 
I am less interested now 



I was not interested and 

I feel the same way now 

I was interested and I 

feel the same way now 

30. Did you discover any new interests by participating in this 
simulation? . 



Yes, I am now interested in_ 
No 



31. Name some of the things you liked most about the simulation 
and some of the things you liked least about the simulation. 

Liked Most Liked Least 
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32. Write down some of your ideas on how the simulation miglit be 
made better. 



As soon as you have completed these questions ^ turn in this booklet 
to your teacher. 

Thank you. 
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/APPENDIX C: 

Midway '..uostionnaire 
and 

General. Module Evaluation 
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MIDNAT QUBSTIOimAIRE 
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heroiii do rr'-*^ !.er..-,7. .!i lly reflect the positioti or policy the 
National [n.tilutc of j:ducation/ and no official oiidorsemeiic by 
tiiG National institute of Education should be inferred. 

Copyrioht J 974 bv the Ohio State University^ The Center for 
Vocational and Technical Education. 

Copyiicjht for these materials is claimed only during the period 
of clevc iopnu;nt , te.3t, and evaluation, unless authorization is 
yranlt>l by the National Institute of Education to claim copyright: 
also Oil tlio final i:iaterials. For information on the status of 
I lie copyright claim, contact either the copyright proprietor or 
t. o n.jtionil ir.sJ:itiite of Education. 
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MIDWAY MODULE QUESTIONNAIRE 



The quustionnairo is divided into several sections. Each section 
in ordor corresponds to a part or a phase of the simuJ.ation module ^ 
The last sections doal with your overal l perce pt ions at this point 
in time >^-'i^rdi.. ; what h-is happened in the module. 

Fill 5.n the informal \>r rr^guested at the top -if the quostioi>s. 
T^, jn a::.5wct each <T'»;:5tio.i by circling the letter in front of the 
phra^«; i}ai Le.-v .! ^ .i*jes your answer, unles-i jiven other spucitic 
direct ioui. in the- -i^^f^stion^ Space has also been provided for you 
Lo writ': ,\ ^n. . »n i-.-.iti;/suggestions you wight have. You are en- 
couraged to do st«* 



F IL J 1^ 1 u Ti I h I 'Oij. \.0W r\'C» IN FOl^TION 

Teachur Name ^School 

Datc^ Part of the Module you are now working on 



IWTPOP'JCTTOIJ TO .SIMULATION 



Ov'iraiJ , how would you rate the technical quality (appcaranno/ 
o..\so u' nzei, etc,) of the slides and booklet? (Answer both 
jKn ty C'*" question if applicable.) 

:'»l3ii'^-G Booklet Comments 



a . 


Very Good 


a. 


Very Good 


b • 


Good 


b. 


Good 




AVoraye 


c. 


Average 




roor 


cl. 


Poor 




Very Poor 


e. 


Very Poor 



2. Ill v;hat order v;ould you recommend the use of slides and the 

t5:^/.K4? ('""''^•^iL. only one). 

J* Use both in any oider 

b. Use with booklet first 

c* Use b(«th with slides first 

d. Use tho booklet only 

o. Use l*he slides only 

f . NOiiO of tiie above 

3* lUoasc record any strengths and/or weaknesses that you observed 
whilo v;orking with this part of the simulation module 
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4. Indicate the form of presentation used (e.^?., booklet, sound- 
siliUc, qamc, etc.) 



How would you rate the technical quality (case of use, appear- 
ance, '?tc.^ f jr media and/or the illustrations for booklets? 

a. Very b* i^io^* c. Medium -5. Low e. Very 
Hiqlj Low 

6. In your juci«ir«e;j t , did this form provide pertinent information 
that :3 udoi V .'.i.^d use in "taking decisions abouv module parti- 
cipation? 

d. Voty i;. Rather c. Average d. Not very o. Wot Perti- 

r^irtinent Pertinent Pertinent nent at all 

?• OverdlJ / how would you rate the ability of the "Preview" form 
tor motivating students to participate in the module? 

a. Very b- High c. Medium d. Low e. Very 
llu]h Low 

8. iMi^asf- iTocord any strengths and/or weaknesses that you observed 
wliile working with this part of the simulation module 



I ^.;</vrioi. ni/iSA::/ ROLK selection 

9. Indicate the form of presentation (e.g., slide-tapes^ booklets, 
etc.) used in the Preparation Phase. 

10. How would you rate the technical quality (e.g., ease of use, 
apntnicanre ore.) for media and/or illustrations for booklets? 

:t. Very b. High c. Medium d. Low e. Very 

i!: M Lov7 

11. How well did the Preparation Phase fit together with the Module 
Prcvie\;? (i.e., did the Preview flow into the Preparation Phase?) 

a. Very b. Well c. Somewhat d. Poorly e. Very 
Well Poorly 

12. Dxd the initial role descriptions provide students with enough 
information for selecting roles? 

a. Yes, the information was very adequate 

b. Ygs^ the information was rather adequate 

c. No, the information was rather inadequate 

d. No, tne information was very inadequate 
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If schematic devices (e.g. schedule cards) v;cr:xc- available to 
help select roles, did students understand how to use them? 



a. Yes, with little or no help 

Yes, with some help 
c- Ygs, with a great deal of help 

Not applicable 

1*^. Were the studc^ntr^ r^ble to independently select themselves into 

a. Yei^, ..i^h l..:tio difficulty 

b. Yes/ with some difficulty 

c. NO, n vr f teacher assistance was necessary 

d. No, extensive teacher assistpnce was necessary 

JLL^ou- had to help students select roles, please describe the 



nature of that assistance (e.g. asked students to draw lots when 
several wanted the same role; explained use of schematic device, 
etc.) in the space below: 



Jo. iMcasft record any strengths and/or weaknesses that you observed 
while working with this part of the simulation module 



FIRST TASKS 



This section inclades questions about the implementation of tasks, 
the flow of one ta^:|: to another, etc. We would like your reactions 
to the itaskLi up t:. point. We realize that you have not completed 

all of the tasks. We Vxi; ask you about the later tasks in the short 
quostionnuire administered after the module has been completed. 

17. m general, was the reconunended time appropriate for completing 
the tasks? 

a. Yes 

b. Somewhat 

c . No 

If ''No," please specify the task(s) 
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18. 



In general, were the tasks appropriate to the maturational 
level of the students? 



a . Yes 

b . Somewhat 
c • NO 

Lf "No/' nlc:ise specify the task{5) 



19. How v;ould you raho the flow or integration of one task with 
another? 

a. Very b. Good c. Average d. Poor e. Very 



20 • bid you hava cfwy special problems or any particular breaks in 
flow? 

a . Yes 

b. No 

If *'Yes," please specify^ 



21. How would you rate student understanding of task directions 
and/or task materials? 

a. Very b. High c. Average d. Low e. Very 



If "Low/' or "Very Low/* please specify 



*.2. Did tlie students have any major problems in implementing the 

tasks? 

a . Yes 

b . Somewhat 

c. No 

If "Yes," please specify 

23. Please record any strengths and/or weaknesses that you observed 
while work!" ; ..'^th this part of the simulation module 



STUDENT INTEREST AND UNDERSTANDING 



24. In general/ were the directions in the module clear enough for 
students to understand what was expected of them? 

a. Very b. Clear c* Average d. Unclear e. Very 



Good 



Poor 



nigh 



Low 



Clear 



Unclear 
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25. In general, was the vocabulary of the module consistent with 
the maturational level of the students in the simulation? 

a. Yes, most b. Yes, some c. No, not d. No, none 
of it of it much of it of it 

26. In cjoneral , were the students able to understand the concepts 
presented in the materials? 

a* Yes, most b. Yes, some of c. No, not much d. No, not 
of the tinio the time of the time at all 

27. in general, did uhe materials stimulate student interest? 

a. YcG, mo';t b. Yes, some of c. No, not much d. No, not 
of the time the time of the time at all 

28. Did your students experience problems with the reading level 
of this siniulation module? 

a. Yes, many b. Yes, some c. Yes, but few d. No 

problems problems problems problems 

29. While v»orking with the students in the simulation module, did 
you spend extra time in reviewing the basic concepts presented 
in that phase? 

a. Yes, I spent much time 

b. Yes, I spent little time 

c. No, I didn't spend any time 

30. Please record any strengths and/or weaknesses that you observed 
while working with this part of the simulation module 



ADEQUACY OF MATERIALS - OVERALL PERCEPTIONS 



31. In general, how well did the transitions from phase to phase 
of the module proceed? 

a. Very b. Well c. About d. Poorly e. Very 

Well Average Poorly 

32. Up to this point, are there any additions, deletions, or 
changes in the module that you feel should be made? 

a. Yes, make the following changes 



b. No changes are necessary 
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33. Are there any parts of the module that "just Uidn't work?" 
a. Yes, the following parts 



b. No, all parts worked well 



34, Ail factors considered, which specific ::ot of materials would 
you rate as the Dosv? 



35. Ail factors considered, which specific set of materials would 
you rato as the worst? 



36. Up to this point, add as many comments and/or suggestions for 
revision of the module as you might have. 
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GENERAL MODULE EVALUATION 
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The project presented/reported heiein was performed pursuant to 
a grant from the National Institute of Education / Department of 
Health, Education/ and Welfare. However / the opinions expressed 
herein do not necessarily reflect the position or policy of the 
National Institute of Education/ and no official endorsement by 
the National Institute of Education should be inferred. 

Copyright 1974 by the Ohio State University/ The Center for 
Vocational and Technical Education. 

Copyright for these materials is claimed only during the period 
of development/ test/ and evaluation/ unless authorization is 
granted by the National Institute of Education to claim copyright 
also on the final materials. For information on the status of 
the copyright claim/ contact either the copyright proprietor or 
the National Institute of Education. 




GENERAL MODULE EVALUATION 



This questionnaire is divided into several sections. The 
first two sections correspond to the last tasks in the module 
(i.e., those from the Midway Questionnaire to the end of the 
module) and to the Summary Phase. The last sections deal with 
general Leacher and student background and your overall percep- 
tions of the quality of the materials, implementational problems, 
student interest and understanding, etc. 

Answer each question by circling the letter in front of the 
phrase that best describes your answer, unless given other specific 
directions in the question. Space has also been provided for you 
to write in any comments/suggestions you might have. You are en- 
couraged to do so. 



GENERAL MODULE EVALUATION 



FILL IN THE FOLLOWING INFORMATION 



■ Teacher Name 



School 



Sex 



Years of Teaching Experience 



City 



LAST TASKS 

!• In general/ was the reconmiended time appropriate for completing 
the tasks? 

a • Yes 

b* Somewhat 

c • No 

If "No/' please specify the task{s) 

2. In general, were the tasks appropriate to the maturational level 
of the students? 

a • Yes 

b • Somev;hat 

c. No 

If "No," please specify the task(s) 

3* How would you rate the flow or integration of the tasks with each 
other? 

a. Very b. Good c. Average d. Poor e. Very 



4. Did you have any particular breaks in flow? 

a • Yes 
b. No 

If "Yes," please specify . 

5* How would you rate student understanding of task directions and/or 
task materials? 

a. Very b. High c. Medium d. Low e. Very 
High Low' 

If "Low." or "Very Low," please specify 

6. Did the students have any major problems in implementing the tasks 

a • Yes 

b . Somewhat 

c . No 

If "Yes," please specify , 



Good 



Poor 



ERIC 



130 



7. Please record any strengths and/or weaknesses you observed while 
working on this part of the simulation modules 



SUMMAT^Y PHASE 

8. How would you rate the effectiveness of the Summary Phase in pro- 
viding a reasonable culmination # i.e., in tying together concepts, 
roles, etc. presented in the module, to the simulation experience? 

a. Very b. High c. Medium d. Low e. Very 
High Low 

9. To what extent was the Summary Phase integrated with the immedi- 
ately preceding activities or tasks? 

a. Very b. Well c. Average d. - Poorly e. Very 
Well Poorly 

10. How would you rate the effectiveness of the Summary Phase in 
helping students learn about occupational roles performed by 
others in the simulation? 

a. Very b. Somewhat c. Not 

Effective Effective Effective 

11. How useful do you feel the Summary Phase would be in helping 
students to make decisions about participation in other occupa- 
tional exploration activities, i.e., other simulation modules, 
etc.? 

a. Very b. Somewhat c. Not 

Useful Useful Useful 

12. Please record any strengths and/or weaknesses you observed while 
working on this part of the module: 
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TEACllKR BACKGROUND 

13* In what kind of group setting (e.g., English classroom, math 
classroom, .students from study hall, students from a guidance 
group, etc.) and at what grade level did you introduce this 
simulation? 

a* Group Setting (please specify) 

b. Grade Level (please specify) 

14, Have you had any previous experience with simulation as an 
instructional technique? 

a. Yes, as a teacher 

b. Yes, as an observer 

c. Yes, as a participant 
d • No 

15, If you answered yes to question 14, briefly describe the 
nature and extent of your previous experiences with simulation 
If your response to question 14 was "No", please proceed to 
question 16. 

a, Ky previous experiences with simulation include 



16. Which of the following statements best describes your reasons 
for participating in the pilot test of this simulation module? 

a. , Wanted to try out new ways of organizing instruction for 

students 

b. Have an interest in Career Education 

c. Thought material was of value for students 

d. Have a general interest or curiosity 

e. I was requested to participate 

f . Other, or some combination of the above (please specify) 
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STUDENT BACKGROUND 



17, How were students selected to participate in the simulation? 

a. Students volunteered from the class 

b. The class # rather than the students , volunteered 

c. Student volunteers f: ,m a study hall 

d. Other/ please specify ^ 



18, If you had volunteer students participating in the simulation ^ 
which of the following reasons best describes your perception 
of why they participated? If you did not have any volunteer 
students, please proceed to question 19. 

a. Interest in trying something new 

b. Interest in particular area simulated 

c. Interest in careers 

d. Interest in just getting out of class or study hall 
Other / or some combination of the above (please specify) 



f, I can't really guess at the reason (s) 

19, Indicate any special characteristics of this class, e.g.# many 
slow readers in class; many students with exceptionally good 
verbal skills; etc./ which may bias the results of the pilot 
test of this module. Also, describe how you feel the results 
will be biased by these characteristics. 

a. Characteristics Biases Produced 



b. No special characteristics 
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I MPLEMENTATION OF THE MODU LE 

20. How well did the in-service training prepare you to work .with 
the module? 

a. Very b. Well c. Somewhat d. Poorly e. Very 
Well Poorly 

21. Did the in-service training provide you v;ith a general* under- 
standing of your role in the module implementation? 

a. Yes 

b« Somewhat 

c. No 

If "No/* please specify 



22. While working with this module, did you have to allot (or spend) 
more time than you normally would for preparation (exclude the 
time spent in in-service training)? 

a. Yes, specify additional time in hours 

b. Some extra time was necessary 

c. No extra time was necessary 

23. How sizable was the job of managing/coordinating (helping 
students, keeping track of materials) this simulation module 
for you? 

a. Very b. About c. Not 

Sizable Average , Sizable 



ADEQUACY OF EVALUATION MATERIALS 



24. Do you feel that the knowledge (Wliat do you know?) and the atti- 
' tude (What do you like?) tests were adequate measures of the 

material contained in the module? (Answer both parts of the 
question, ) 

Kpowlodgc Test Comments Attitude Test Comments 

a. Yes a. Yes 

b . Somewhat b . Somewhat 

c. No c. No 

25. To what extant was the knowledge test difficult for students? 

a. Very b. Difficult c. About d. Easy e. Very 
Difficult Average Easy 
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STUDENT UNPaRSTANDING, INTEREST ^ AND PARTICIPATION 



26- In 'leneral, were the directions in the module clear enough for 
students to understand what was expected of them? 

a. Very b. Clear c. Average d. Unclear e. Very 

Clear Unclear 

27. in general, was the vocabulary consistent with the maturational 
level of the students in the simulation? 

a. Yes, most b. Yes, some c. No, not much d. No, none 
of it of it of it of it 

28. Did your students experience problems with the reading level of 
this module? 

a. Yes, many b. Yes, some c. Yes, but few d. No 

problems problems problems problems 

29. To what extent do you feel students were receptive (interested 
in, excited by) to simulation as a way of learning? 

a. Very b. Receptive c. Average d. Non- e. Very non- 
Receptive Receptive Recepcive 

30. To what extent do you feel that students were receptive (interested 
in, excited by) to the content of this particular module? 

a. Very b. Receptive c. Average d. Non- e. Very non- 
Receptive Receptive Receptive 

31. Was there any change in student interest or motivation as they 
progressed through the module? 

a • Yes 

b. Somewhat 

c. No 

If "Yes,** interest changed as follows 



32. Do you feel that this module reinforced or helped to build the 
student's ability to make decisions? 

a. Yes 

b. Somewhat 

c. No 

d. Don't know 

If "Yes," please specify how 



33. In your judgment, how much did the students learn about the 
{process of simulation (role playing / problem solving, group 
interaction , etc . ) 

a. Very Much c. An average d. Lrittlo e. Very 

Much amount Little 

34. In your judgment, how much did students learn about the content 
of the module? 

a. Very b. Much c. An average d. Little e. Very 
Much amount Little 

35. Are there any students or groups of students (e.g., some students 
may have difficulty working in small self -directed groups) that 
you feel would have difficulty in participating in simulated types 
of experiences? 

a. Yes 

b. No 

If "Yes," please specify^ 



36. For what grades would you consider this module to be appropriate? 

a. 10th or b. 9th c. 8th d. 7th or e. Other 
higher lower 

37* Ideally, how many students should participate in this module? 

Number of students 



38. In general, did this module change the working relationships 

(personal interactions) between you and participating students? 

a. Yes 

b. Somewhat 

c. No 

If "Yes," or "Somewhat," the relationship changed as follows 
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OVERALL PERCEPTIONS AND RECOMMENDATIONS 



Overall, how would you rate the quality of the module? 

a. Very Good Average d* Poor e. Very 

Good Poor 

If possible, would you use this module with students again? 

a. Yes, with no modifications 

b. Yes, with minor modifications 

c. Yes, with major modifications 
No 

Please comment, if you wish^ 



41* Would you recommend this module to other teachers? 

a • Yes 
b. No 

Please give your reason (s) 



42* Were the main ideas and themes presented with logical consistency 
in the content of the module? 

a. Yes 

Somewhat 
c. No 

If "No," please specify where the problems occurred 



43* 


All factors considered, which specific set of materials 
you rate as the best? 


would 








44. 


All factors considered, which specific set of materials 
you rate as the worst? 


would 








45. 


Add as many comments and/or suggestions for revision of 
module as you might have* 


the 
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S IMULAT TOK OnSKI^VKRS FORM - A 



'^'hiiy instrument is designed to obtain namples of on^g^ing cJascroom 
behavior of students using simulation modules. These modules are being pilot 
tested as a part of the Occupational Kxploration Program by the Center for 
Vocational and Technical Education at The Ohio 3tate University and the Jefferson 
County Public Schools. 

The observation form is made up of a set of three sheets. Each set contains 
four parts: the heading, media section, general comments and the interaction and 
activities section. An observation form set is to be used for each period that 
is observed. The parts of each set are discussed below. 



The 'foiidinf/ 

The heading simply identifies the time, place, obs*c:rvcr and the portion of 
the modulo that was observed. For ease of completion, the observer's naiae, school, 
and module have been p^iven a number code. Simply circle the appropriate number 
according to the code below: 

Observer: Numbers will be assigned 

School: 1. Alameda Junior High 

2. Hamilton Junior High 

3. Lake Junior High 

. Wheat Hidge Junior High 

Module : 1 . Clommunioati ons 

2. Product Services 

3» Insurance 

h. Health & Welfare 



Date: 



Indicate the date of the observation 



Activity or 
Activities : 



Indicate either the title of the activity i.e. "Preview" 
^'Summary" or the number i.e. "Task 3" etc. Several 
spaces are provided in the event that more than one task 
or activity takes place in one period. 



1, Media 

The media section has two spaces that should be completed each time the 
pupils use some form of media, [n the space following the type of media used, 
place a check {^) each time the media is used. For each (/^), the number of 
students using that form of media should be indicated in the No. of Student? 
Column* (See sample). 
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2, General Commentr. 



The f^eneral comments section is desir.ned to capture commentr, that do not 
lend themselves to the other categories* Two categories that are of continuing 
interest Ls the amount of time spent by pupils getting ready to start and the 
amount of time cleetninp, up and gettin*^ ready to leave • You will note that these 
catef^prier: are pre -printed on the observation form. (Examples of general comments 
of interest appear on the sample form)* 



3» Interaction ?c Activities 

This section is designed to provide several kinds of information: 

a. How frequently do certain categories of events occur? 

b. What sixe group were the students in during the event? 

c. What were the circumstances surrounding the event? 
and in some instances : 

d. How long did the event last? 



The procedure for this section is as follows: Each tine one of the events 
in either the student or teacher activity columns occurs record an arable number 
in either the total group or sub-group column* (The total group column is 
appropriate when all of the students are working together), (The small group 
column is appropriate when the students are working individually or in two or 
more groups)* Begin with number 1 each period; then number the events consecutively 
throughout the period* The comment section is provided in order that a very 
brief comment or key word may be used to explain each arable number* (See example)* 
NOTE ; The events for the entire period should be numbered consecutively even 
though they axe scattered between categories a through f* This system will allow 
the evaluation staff to reconstruct what happened during each period* 

Tf a nu;nber of questions about the same thing occur in category a, the 
numbers may be bracketed as is shown in the sample* Also if a number of questions 
follow each other, it is of interest how long the questioning took* (Again see 
the example)* 
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Explanation of Sample Form 



^loading * This form was completed by observer number 2 at Alameda Junior 
High on Task 1 of the Communications Module, March 21, i97*u Sight pupils were 
present the day of the observation • 

iMed'ia Section , 

During the observation period, the students used two media forms in Tasks 
1 8c 2. They began with the sound/slide presentation, switched to the booklet, 
and finally used the booklet as they began Task 2. The media in each instance 
was used by the total group. 



General Comments . 

Some of the general comments relate to other parts of the observation form 
in the sample, others are simply given as examples of the kinds of comments that 
might bo appropriate. Note that it took the students 5 minutes to get started 
and 3 minutes to get ready to leave. 

The comment space is designed to capture your overall impressions of special 
or noteworthy events occurring during the period. 

Interaction and Activities Section . 

This section provides a sequential history of what happened during the 
period • By reading the Arabic numbers and comments in order, the sample allows 
the following reconstruction of events. 

1. The pupils began as intended by viewing the slide tape as a 
total group. 

2. Someone asked for help with the slide tape machine. 

3. As the teacher helped with the machine, other students began 
to "horse around". 

U. The teacher, discovering the machine was broken, directed the 
pupils to use the booklet instead. 

5. Teacher stopped the horseplay and redirected the actions of 
the miscreants* 

6. A pupil asked for help in finding a booklet. 

7. A pupil did not understand the booklet. 
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8, 9> 10> !!• A number of questions were asked regarding what 
should be done following the booklet - 5 minutes 
were consumed • 

12. The pupils broke up into fcroups at this point, (The obf?erver 
is now focusing on one of tht. jjDups only). 

13. The teachar redirected the leader to his proper gi^o^P* 

The small group assembled ft began to discuss their task as 
intended. 

15 • The task was completed, the product (a report in this instance) 
was completed. The total ^proup moved on to Task 2 as the time 
came to begin t-he cleanup /put -av/ay procedure. 



Footnotes 

Obviously all that transpired during the period was not recorded. No 
observer "should feel they must capture every single event or question. With 
experience and through use of the flow chart for the module being observed, 
observers will become increasingly capable of capturing the more significant 
questions, events, etc. 

Should questions arise, do not hesitate to contact John Radloff, Jeffco 
Career Education Office - t^2 3-7010. 
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